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PREFACE 


This volume has been written under BuAer Contract NOas 51-514(c) to provide en- 
gineers with analytical and other techniques basic to the unified approach to problems 
of aircraft control system design. 


A large portion of the volume is a codification of existing techniques and material 
appearing in textbooks and published papers. However, acertain amount of new 
material is also presented for the first time in published form. Bibliographies cover - 
ing the major source material are appended to each chapter. 


This volume has been written from the point of view that the basic approach to control 
systems problems is of necessity through the transfer function. The various ways of 
dealing with such problems in practice are essentially means of getting various de- 
grees of approximations to the transient solution of the equations of motion from which 
the transfer functions are derived. Since the object of prime interest in control and 
servomechanisms work is the transient behavior of the system under consideration , 
it is felt that this approach will provide the control systems engineer with a relatively 
new codifying concept with which to attack his problems. 


The authors are indebted to many individuals and companies who have aided or in- | 
fluenced this volume either directly or indirectly, and particularly to the Bureau of 
Aeronautics of the United States Navy. Special appreciation is due to Mr. L. M. 
Chattler, Mr. R. A. Benneche, and Mr. J. Folse, of BuAer, whose foresight and 
continued interest have made this project possible. Special mention should be given 
to Juanita Zimmerman, Betty Harsey, Elias Moness, F. B. Bacus, J. Moser, and 
James Jones of the Northrop Servomechanisms Section for their untiring efforts in 
preparing the manuscript for publication; also to K. B. Tuttle, who was charged with 
the responsibility of coordinating all the individual efforts involved. The arduous 
task of writing this book has been made a more pleasant one by the continuing interest 
and able assistance of all those mentioned above and the entire Northrop Engineering 
Division. 
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IMPORTANT NOTE 


This volume was written by and for engineers and scientists who are concerned with 
the analysis and synthesis of piloted aircraft flight control systems. The Bureau of 
Aeronautics undertook the sponsorship of this project when it become apparent that 
many significant advances were being made in this extremely technical field and that 
the presentation and dissemination of information concerning such advances would 
be of benefit to the Services, to the airframe companies, and to the individuals con- 
cerned. 


A contract far collecting, codifying, and presenting this scattered material was 
awarded to Northrop Aircraft, Inc., and the present basic volume represents the 
the results of these efforts. 


The need for such a volume as this is obvious to those working in the field. It is 
equally apparent that the rapid changes and refinements in the techniques used make 
it essential that new material be added as it becomes available. The best way of 
maintaining and improving the usefulness of this volume is therefore by frequent re- 
visions to keep it as complete and as up-to-date as possible. 


For these reasons, the Bureau of Aeronautics solicits suggestions for revisions and 
additions from those who make use of the volume. In some cases, these suggestions 
might be simply that the wording of a paragraph be changed for clarification; in other 
cases, whole sections outlining new techniques might be submitted. 


Each suggestion will be acknowledged and will receive careful study. For those which 
are approved, revision pages will be prepared and distributed. Each of these will 
contain notations as necessary to give full credit to the person and organization re- 
sponsible. 


This cooperation on the part of the readers of this volume is vital. Suggestions for- 
warded to the Chief, Bureau of Aeronautics (Attention AE-612), Washington 25, 
D. C., will be most welcome. 


L. M. Chattler 

Head, Actuating & Flight Controls Systems Section 
Airborne Equipment Division 

Bureau of Aeronautics 
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CHAPTER I 


GENERAL CONSIDERATIONS 


The purpose of this volume is to present the systems 
engineer with essential mathematical tools for solving 
problems arising in piloted aircraft control system 
design. This introductory chapter is devoted to survey- 
ing some of the general principles involved and to de- 
fine certain important terms. 


As far as his degree of control over the airplane is 
concerned, a pilot may be said to engage in two types of 
flight activity in the course of a mission. The first of 
these, usually called navigation, does not require great 
precision of control but enables the pilot to fly the air- 
plane to some point at which he begins the second type 
of flight activity characterized by the much greater 
control needed, During this second type of flight, the 
pilot must direct the airplane in some precise geo- 
metrical relationship to an object on the ground or in 
the air. The object on the ground may perhaps be the 
landing field where the pilot will terminate the flight or 
a target which is to be bombed; the object in the air 
mgay perhaps be an enemy aircraft which is to be de- 
stroyed or a friendly aircraft with which the pilot is 
to fly in completing a mission. Depending upon the 
particular situation, it can be seen that this precision 
type of flight is required in such activities as landing, 
tracking, gunlaying, and bombing runs. The essential 


difference between the two types is one of precision of 
control maintained by the pilot; the essential likeness 
is that the pilot is primarily interested in directing or 
commanding the airplane to assume a certain orientation 
in space. 


The pilot uses the cockpit control devices for two func- 
tions: to command and to stabilize the airplane. The 
difference between these two functions can be clarified 
by a simple but common illustration: 


A pilot takes an airplane aloft and at a certain 
flight condition attempts to establish a certain 
rate of climb. He pulls back on the stick and 
holds it steady. In response to this com- 
mand, the airplane smoothly takes up a 
steady climb. However, the climb rate is 
not precisely what the pilot wants, so he 
applies a slight forward force to the stick . 
The airplane then pitches forward, and the 
rate of climb is reduced. But it is reduced 
too much, so the pilot applies back pressure 
again, and again the airplane climbs too 
fast. This procedure continues: The pilot 
adjusts the stick forward and backward 
continuously, and the airplane pitches up 
and down without ever settling down to the 
desired rate of climb. 


In this example, the pilot was unable to command a rate 
of climb and get exactly what he wanted. He had to 
jockey the stick back and forth, climbing first too fast, 
then too slowly. The average rate of climb was pro- 
bably satisfactory, but the pilot was compelled to work 
very hard to maintain it. If he had been able to stabilize 
at the desired rate of climb after perhaps one or two 
small corrections with the stick, he would have been 
satisfied; but he was not satisfied with the oscillating 
response he actually achieved. 


However, performance was unsatisfactory only if the 
pilot insisted on getting exactly the rate of climb he had 
initially decided upon. As long as he placed the stick in 
a certain position and held it there (command input), the 
airplane flew smoothly with no tendency to oscillate; its 
flight behavior was stable. It was only when he attempted 
to make certain fine adjustments that the oscillation 
occurred. The airplane by itself was stable. What was 
unstable was actually the pilot-airplane combination . 


To solve a problem of this sort, one must study three 
factors: a) the pilot, to determine how he responds to 
certain stimuli, such as pitch angle, normal accelera- 
tion, and stick force; b) the airplane, to determine how 
it responds to certain control movements and air forces, 
such as backward and forward stick deflection, lift 
changes, and pitching moment changes; and c) the pilot- 
airplane combination as a system, to determine how they 
will interact with each other. 


When this has been accomplished, changes can be made 
in certain elements to produce a better system. 


This volume presents techniques suitable for handling 
feedback control systems problems of types of practical 
importance to engineers concerned with the design of 
flight contral systems, of which the one considered above 
is an example. These are the methods of analysis: 
methods of determining how a system or elements of a 
system behave when subjected to command inputs or to 
external disturbances. The volume goes beyond anal- 
ysis, however, and considers methods of synthesis , 
that is, procedures for determining the best way of 
selecting many elements and combining them into a 
system. Analysis takes a given system and determines 
its behavior, whereas synthesis creates a system which 
will behave according to a certain desired pattern. 


In building up a control system, it is usually con- 
venient at first, and often necessary, to "live with" a 
certain number of components. In controlling an air- 
plane, for example, the airframe must usually be ac- 
cepted without change because certain design parameters 
affecting its performance were determined by considera- 
tions other than control, such as landing speed and 
maximum gross weight. Those elements which are 
accepted without change are referred to as unalter- 
able elements. All the other elements in the system 
which can be chosen or designed at will to obtain the 
desired performance are called alterable elements. 
In the example used above, certainly the pilot and most 
probably the airframe would be considered unalterable 
elements. The surface controls would be the alterable 
elements, Thus a problem in analysis can be considered 


as one in which the behavior of the system is studied 
to indicate which of the alterable clements might be 
changed to produce satisfactory performance. On the 
other hand, synthesis is concerned with designing or 
choosing alterable elements which will enable the system 
to produce a desired performance. 


The term system, as used in this volume, may be de- 
fined as any group of interacting entities required to 
account completely for the physics of a particular 
observed phenomenon. This definition includes systems 
as simple as a pendulum and as complex as an aircraft 
fire control system. For the pendulum, the interacting 
entities are gravity, the atmosphere, bearing friction, 
and the mass of the pendulum. 

In an aircraft fire contro] system, there are too 
many elements to list here. However, a pertinent point 
is that many of the elements are themselves complex 
"sub-systems," such as a tracking radar system or a 
pilot-controls-airframe combination similar to the 
one described earier in this chapter. 


The purpose of this survey has been to present some 
general considerations relating to the design of piloted 
aircraft control systems: in subsequent chapters, the 
mathematical means for dealing with design problems 
are discussed. 


This volume is directed to college graduate engineers. 
Consequently, the entire effort is toward a logical 
presentation of the methods of analysis and synthesis. 
This precludes digressions for the presentation of 
general background material. However, since it is 
expected that the engineers who use this book will have 
backgrounds in various branches of engineering, not 
all of which make use of the mathematics pertinent to 
controls analysis, an appendix is included which touches 
briefly on important topics. It is highly recommended 
that the reader scan the appendix so that he may acquaint 
himself with any unfamiliar material found there, 


In addition to certain mathematical material, the ap- 
pendix contains a rather extensive glossary of terms. In 
particular, many new definitions are given to old and 
familiar words. Although this may at first seem arbi- 
trary, experience will show that once these definitions 
are well fixed in mind, the text can be followed with 
much less confusion than would exist had the definitions 
been left to chance. The reasons for this are simply 
that automatic control theory is relatively new and that 
there are a number of systems of nomenclature in use. 
If no standardization were settled upon for this book, no 
two readers would gather the same impressions from the 
text. The definitions adopted by the AIEE- ASME joint 
committee at the time this volume is published are used 
whenever possible. A list of these symbols and de- 
finitions is given in the glossary, together with those 
of whatever standards exist in fields where the AIEE- 
ASME presentation is not applicable. 


The main body of text can be divided into three major 
divisions. The first division is simply Chapter II in 
which fundamental background material relevant to the 
description of system behavior is presented. Chapters 
III, IV, and V form the next major division. These 


chapters are concerned solely with the analysis and VII and VIII are devoted to machine methods of handling 
synthesis of linear systems. The third division consists analysis and synthesis problems. These chapters com- 
of Chapters VI, VII, and VIII and considers not only plete the volume. 

linear devices, but also non-linear systems. Chapters 
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CHAPTER II 
FUNDAMENTAL CONCEPTS 


SECTION {! — INTRODUCTION 


This chapter discusses the means of describing control 
systems in order to facilitate analysis and synthesis. 
The mathematical form used to describe a system and 
each of its components is called "the transfer function." 
The transfer function of a linear system completely 
specifies its dynamic performance in terms of the 
Laplace transform variable s and certain fundamental 
parameters such as natural frequency, time delay, and 
damping ratio. Since control systems analysis and 
synthesis arecarried on almost entirely in terms of 
transfer functions, it is important that the forms, 
meanings and various graphical represeniations be 


firmly established. 


The transfer function is essentially a "mathematical 
model" of a unit or system, and it is manipulated like 
a laboratory model in order to produce satisfactory 
performance. 


Manipulation of the transfer function is greatly facili- 
tated by a number of graphical aids that show relation- 
ships between the transfer functions of the individual 
components of a system and promote visualization of 
the transfer functions themselves. 


SECTION 2 ~ MATHEMATICAL MODELS 


(a) GENERAL 


Given the problem of designing a gear unit, an engineer 
proceeds by first considering the physical requirements , 
such as mechanical advantage, pitch diameter, and 
stresses. Bearing in mind such further factors as 
producibility and availability of material, he formulates 
his design. These ideas are then converted into work- 
ing drawings, from which the gear is produced. Finally, 
the finished product is tested. 


Essentially, the design procedure may be summarized 
as follows: 
1. The requirements of the design are determined . 
2. Calculations are performed in order to deter- 
mine controlling parameters. 
3. The best methods of meeting requirements are 
determined. 
4. Working drawings are prepared. 
5. The unit is constructed. 
6. The completed design is tested. 


A similar procedure is followed in designing control 
systems. However, the complexity of such systems 
makes a more extensive design procedure necessary . 
Following the formulation of the design, a rigorous 
analysis must be applied to answer these questions: 

1. Is the basic concept sound? 

2. How does the system perform? 

3. How well does the system perform? 

4. How can the system be improved? 


These analyses can sometimes be done through labo- 
ratory experiments. As an example, consider the 
analysis of an electrical distribution network. The 
system is simulated in the laboratory by assuming that 


lumped parameters approximate the distributed capaci- 
tances, ‘inductances, and resistances. These para- 
meters, along with variables such as Joading conditions 
to represent disturbances, are varied,and measure- 
ments of the responses are made. Because of the as- 
sumption of lumped parameters, the results are not 
a perfect representation of the physical system. How- 
ever, they are the best obtainable under laboratory con- 
ditions and may yield a great deal of useful information . 


The complex nature of most control systems often pre- 
cludes the laboratory experiment method of analysis. 
However, one can come close to achieving the advan- 
tages of the laboratory experiment by performing the 
experiment on paper. Mathematical equations may be 
used to represent a physical system in much the same 
way as the laboratory model simulates it. When prop- 
erly derived,both the mathematical and laboratory 
models should reflect, within certain limits, the charac- 
teristics of the physical system being analyzed. What 
these limits are is determined by the assumptions used . 
Obviously, a mathematical model derived from unfounded 
assumptions will lead to grossly misleading conclusions . 
Consequently, assumptions must be made with great 
care. Precautions must be taken throughout the analysis 
not to lose sight of these assumptions and to realize 
that they limit the validity of the final conclusions. 


In order to provide a reminder, it is wise to make a 
complete and well defined list of assumptions which 
control the analysis. This procedure yields additional 
benefits. For one thing, in order to express precisely 
what he has ir .. tnd, the engineer must think critically 
about his state...unts. For example, it is easy to make 
the mental assumption "no friction, " but it requires 
more careful consideration to write down precisely 
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where there is no friction. In considering "where, " the 
engineer often discovers that the assumption is un- 
reasonable and hence changes his attack. Another 
additional benefit derived from the list of assumptions 
is realized when discrepancies occur between analytical 
and experimental data. Reference to the list usually 
points to the cause. 


For these and many other reasons, it is highly recom- 
mended that all assumptions be listed before proceed- 
ing on any analysis problem. 


(b) LINEARIZ ATION 

One of the most important assumptions usually made 
in analysis concerns the "linearity" of the elements 
of the system. The system shown in Figure II-1 is 


considered in some detail in Section II-3 where the 
following equation is derived. 
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Figure II-1. Second Order System 


Since x is the displacement of the mass, this equation 
shows that the sum of the inertia force (Md x/dt?), the 
dumping foroe (Bdx/dt), and the spring force (kx), 
equals the driving force, Q(t). In order to solve this 
equation conveniently, the following three assumptions 
are made: 

1. The mass M iS constant. 

2. The damping factor B is constant. 

3. The spring characteristic k is constant. 
If these statements are true, (II-1) is of the form: 


d"x d®-', d®-?y dx 
(11-2) 4ogpn* Sigpa-T* Sagga-at ©" t4n-1g7 + om = Q(t) 


where uy, a1,...-,84, -- no are cunStants,and Q(t) is 
some function of time (t). Equations of the form of 
(11-2) are called linear differential equations with 
constant coefficients and are readily solved. However, 
none of the three assumptions is precisely correct. 
Consider, for example, the spring characteristic 
k . One form which this quantity may have is illus- 
trated in figure II-2. 


The essential point here is that the spring characteristic 
k is a function of the dependent variable x. If M and 
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Figure II-2. Non-Linear Spring Constant 
B vary in a similar fashion, (II-1) takes the form: 
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This is known as a non-linear differential equation. In 
the simple example chosen,it was assumed that the 
f,(x) were functions of x only. In general, however, 


fo [x 3, dt2'"" a 


In most cases equations of the type of (II-3) are solved 
only by lengthy computations. However, in some cases, 
such as that represented by figure II-2, an additional 
assumption can be made that reduces the equation to 
the form of (II-2). Specifically, it can be assumed 
that the range of values of x is restricted so that the 
slope of the curve is constant. This is called the 
linear range of x. 


It can be inferred from the discussion that one necessary 
characteristic of a linear system is that the static re- 
lationship between the input and the output is a straight 
line. Systems which do not satisfy this criterion are 
said to have non-linear static characteristics. 


Non-linear static characteristics are divided into two 
main classifications: 

1. Continuous non-linearities. 

2. Discontinuous non-linearities. 


Figure II-2 represents a continuous non-linearity . 
Figure [I-3a represents a different type of non-linear 
Static characteristic in that there is no Straipht line 
portion. The device represented might be a pressure 
transducer, fi re II-3b, in which case the input is 
pressure and) output is volts. The curved line on 
the graph of input vs. output represents the actual 
Static characteristic of the system. The dotted strauzht 








lines represent several different possible linear ap- 
proximations to the true curve. If the operating range 
of interest were large and symmetrical about the origin, 
the line xy would be used. If the operating range were 
small, the line uv would be used. If the range of opera- 
tion centered about the point a, the straight line passing 
through that operating point would be used to represent 
the system static characteristic. Whenever the true 
characteristics of a system are approximated by a 
straight line in this manner, it is said that the system 
has been "linearized." 
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Figure II-3. Continuous Non-Linear System 


Suppose that the pressure transducer were redesigned 
so that it had a static characteristic represented by 
the line xy. Next, assume that the potentiometer 
wiper attachment to the bellows became loose. The 
unit would then appear schematically as in figure II-4b. 
The bellows can now move through a certain distance 
without moving the potentiometer wiper. The result 
is a discontinuous static characteristic as shown in 
figure II-4a. This type of discontinuous non-linearity 
has as its essential feature a hysteresis loop and is 
called backlash. Note that it can be referred to in 
terms of the output or input. 





The only way to linearize a system of this type is to 
assume that the backlash is negligible. This is equiva- 
lent to saying that the range of operation of greatest 
concern is large compared to the backlash. This 
Situation is illustrated in figure II-5. 


Figure II-6 illustrates some other important dis- 
continuous non-linearities. 
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Figure II-¢, Backlash Type Discontinuous 
Non-Linearity 


Threshold or flat spot, figure II-6b, occurs in a system 
equivalent to that of figure II-4 with the addition of a 
centering spring from the potentiometer wiper to the 
case. Whenever the bellows has moved beyond the 
threshold region, the spring holds the wiper against 
the wiper attachment. Thus when the bellows reverses 
its direction of travel, there is no lost motion until 
the threshold region is reached again. 


Preload, figure II-6c, is characterized by a step funct- 
ion force or torque versus a displacement away from 
neutral. Note that the applied force on a device with 
this characteristic can vary from minus the preload 
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Figure II-5. Backlash 
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value to plus, without causing any displacement . 


Coulomb friction has the same relation to velocity 
that preload has to displacement, figure II-6d. As 
Shown in the illustration, a force equal to the friction 
is required to produce a displacement away from zero. 
To reverse the direction, the force must be reduced 
to zero, then applied again in equal strength in the 
opposite direction. 


Detent, figure II-6e, differs from preload in that the 
force reduces to zero at some small value of dis- 
placement. The shape of the detent characteristic is 
determined by design. 


Stiction, figure I-6f, is usually assumed to be related 
to velocity as detent is related to displacement. In 
general, this assumption is valid only for very low 
values of velocity. Stiction differs from coulomb 
friction in that the force reduces to zero at some small 
value of velocity. 


All of the non-linearities so far discussed have con- 
cerned behavior of a system near neutral or the null 
point. An important non-linearity encountered with 
larger values of input and output is limiting, figure 
II-6g. This characteristic occurs in any real system. 
The usual assumption is that the operating range of 
significance in analysis is "below saturation." 
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There are many other types of non-linearities that 
are important in certain control system analyses, 
andthese are discussed in some detail in Chapter VI. 
The essential point to be gathered here is that these 
examples are typical of what is not acceptable if the 
system is to be represented by linear differential 
equations with constant coefficients (II-2). 


So far only those effects of coefficients varying with 
the dependent variable (x) have been considered. The 
coefficients may also vary with time. In the simple 
mass-damper-spring example shown above, the tem- 
perature of the environment may be changing in some 
fashion. If this were the case, M, B, and k would 
also vary with time; then (1-1) would take on the form: 


(11-4) 
f (yt er (t) ae ere foe (tye (t)x= Qt) 
oe ath” a getel ee? geo} ae at a 


This is known as a linear differential equation with 
variable coefficients. It is more readily solved than 
a non-linear equation, but the process is much more 
involved than that required for the simple linear equation 
with constant coefficients. In particular, it is not amen- 
able to any of the methods to be used in @hapters III 
through V. Consequently, the remainder of this chapter 
is devoted to mathematical models that can be derived 
from equations typified by (II-2). 


SECTION 3— BLOCK DIAGRAMS AND TRANSFER FUNCTIONS 


(a) THE BLOCK DIAGRAM 


Engineers have developed methods of working with 
drawings and diagrams especially designed to provide 
useful information and to aid in the visualization of 
certain aspects of a problem. For example, figure 
II-7 shows a pump geared to a motor whose field voltage 
is supplied by a remotely located control box. This 
diagram provides information regarding the number of 
units composing the system and their relative locations 
and sizes; that is, it conveys a description of some 
of the external features of the system. However, it 
does not provide a thorough understanding of how the 
system operates. The operation may be seen more 
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readily in the schematic diagram of figure II-8. 


This figure shows an amplifier supplying a voltage, 
Vo, to the control field of a motor. This voltage alters 
the motor torque, thus effecting a change in motor 
speed, n,, with a corresponding perturbation of the 
rate of flow of fluid,Q,, in the outlet pipe. The flow 
of fluid impinges on the flowmeter vane which is 
balanced by a spring. A potentiometer attached to 
the vane puts out a voltage,Vp, proportional to vane 
deflection (and consequently, proportional to Qo). The 
flowmeter potentiometer is connected to the control 
potentiometer in a bridge circuit. Thus, when the 
control potentiometer is turned clockwise, the voltage, 
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Figure II-7. Pump Drive System 
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Figure 11-8. Schematic Diagram of Pump Drive System 


V,, iS increased so that a voltage V,: V,- Vp, appears 
at the amplifier input. The amplifier contains special 
circuitry which increases the current in the motor 
control field until the flowmeter voltage, V,, just 
balances the control potentiometer voltage,V,, (i.e., 
V,- Vp: 0). In this way precise control is maintained 
over fhe flow rate Q. 


Although figure II-8 is an abstraction that bears only a 
slight resemblance to figure I-7, it is useful because it 
shows the functional relationships of the entire system. 
Thus, it serves as an aid to the formulation of the math- 
ematical model of the system. In fact, one of the equa- 
ticns has already been derived, namely, V,"V,- Vp. This 
equation shows that the amplifier input voltage is the 
difference between the control potentiometer setting and 
the vane potentiometer position. This relation will be 
used later in deriving the complete equation of the 
system. 


An even more abstract representation of the system 
can be devised which allows direct determination of the 
mathematical model. Consider first the amplifier. It 
has as its input, Ve , the difference between the control 
potentiometer voltage and the flow meter potentiometer 
voltage. Its output is the motor control field voltage, 
V, . This can be represented as in figure II-9. 





Amplifier 


Figure I1-9. Block Representation of Amplifier 


The term Y, in the figure is referred to as the amplifier 
transfer function because it transfers the input to the 
output, and it is a mathematical expression of the 
amplifier performance. That is, the output of the 
unit is given by V,« Y,V.- 


The motor operation may be expressed in a similar 
fashion by a block as in figure II-10. 


Notice here that the motor input voltage is the amplifier 
Output voltage and that the motor output is the rotational 
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speed n,. The function Y, transfers the input V, to the 
output n,. 





Figure I1-10. Block Representation of Motor 


There is another input to both the motor and the ampli- 
fier, namely, the line voltage (see figure II-8). How- 
ever, this voltage is considered as merely an energy 
source of constant magnitude. If this assumption is 
true, only the steady state characteristics of the 
System are affected. In this particular case, line 
voltage is important because it determines the steady 
State speed of the motor. The question of primary 
importance in the analysis treated in this book is: 
"What happens to the system when it is disturbed 
Slightly from the steady state operating point?" Con- 
sequently, the transfer function is concerned only 
with those inputs which will help answer this question . 
An important assumption upon which all the analysis 
treated in this volume is based_is that < a static analysis 
has p has previously be ‘been m en made and it | has b been ascertained 


that the system is capable of operation at the steady 
State operating point under consideration. 


Returning to figure II-8, the gear unit and the pump 
may also be represented by blocks, each with a transfer 
function relating the output to the input, figure H-11. 
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Figure I1-11.,. Block Representations 


In figure II-11, the output quantities are defined by 
No* Yon, and Qo= Ypn.. 


Combining figures II-9, II-10, and II-11 results in 
figure II-12. 


ee 


This combination of blocks is known as a block diagram. 
It shows the cascade arrangement of the amplifier, 
motor, gearing, and pump. As yet, this block diagram 
is not a complete functional representation of the pump 
drive system since the function of the flowmeter in the 
system is not yet accounted for. However, the diagram 
does show the transfer of an input (control) quantity , 
V., through various functional components into an 
output (controlled quantity) fluid flow, Q,, and on this 
basis could be called a control system. But regarded 
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+ 
symbol a a - called a differential, which repre- 
sents the equation Ve“ V, - Vp: 


The complete block diagram for the pump drive system 
is derived by combining figures II-12, I-13, and 1-14, 
and is shown in figure II-15. Notice that by following 
the arrows away from the differential to the right and 
back through the flowmeter, a complete "loop" is 
described. Systems that can be represented in this 
way are known as closed loop systems and are dis- 





Amplifier Motor 


Figure II-12. Block Diagram 


as a system, it has the serious deficiency that any 
variations of the pressure of the fluid supply to the 
pump produces a change in the output quantity, Q,. It 
is evident that to maintain a constant output flow, q,, 
with this system, some means would be needed to vary 
the input, V.,whenever changes occur in Q,. 


This means is provided by a flowmeter used as shown 
in figure II-8. The flowmeter, driven by the fluid, 
turns a potentiometer, which produces a voltage, 
Ve . This is represented by figure II-13. 
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Figure I1-13. Block Representation of Flowmeter 
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The position of the control potentiometer wiper, and 
thus its voltage, is proportional to the desired flow, 
V,"Y.Q, - By virtue of this circuitry, the voltage into 


Differential 
Control Amplifier 
Polentioneter y 
P 


Gearing Pump 


of Portion of Pump Drive System 


tinctly different in their properties from those that 
can be represented by simple cascading of elements as 
in figure II-12. 


' The blocks starting with the amplifier and ending with 


the pump form what is known as the forward loop 

elements of the system;* that is, these units transfer 
the input forward to the output. The flowmeter, which 
feeds information from the output back to the input, 
makes up the feedback loop element of the system . 


If, in this closed loop system, the output, ,iacreases 
for some reason, the feedback voltage, V,,will also in- 
crease. And since the input to the amplifier is 
Vv." V,- Vp,the amplifier will reduce the motor control 
field voltage and, consequently, the pump output, Q, . 
Automatic regulation of the flow is thus achieved. 


If the flowmeter is removed, the feedback from output 
to input is removed which opens the loop of the block 
diagram. The system then assumes the iorm of figure 
II-12 and is called an "open loop" system. 


A homely example is presented now to emphasize the 
difference between open and closed loop systems. 
Consider the automatic washing machine. This device 
cannot sense the degree of dirtiness of the clothes and 
performs each operation of its cycle only for a pre- 
determined length of time. This is an open loop system . 
On the other hand, when the clothes are laundered by 
hand, the time and energy expended are a function of 
the-dirtiness of the clothes because the washerwoman 


rn oe 


Motor Gearing Pump 


Ea . 


Flowmeter 


Figure 11-15. Block Diagram of Pump Drive System 


the amplifier is the difference between the flowmeter 
potentiometer output,V,, and the control potentiometer 
setting, V,.. This is indicated by the scheme shown in 
figure I-14. ‘The illustration aiso introduces a new 


The tena forward loop and feedback loop are mis- 
leading sic: “loops” as such are not referred lo. 
However, becuuse of long usuge, they are commonly 
uccepted. In this volume, they are also referred 
to as forward path and feedback path. 
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continuously observes the clothes and controls her 
behavior according to her degree of satisfaction with 
them. Thus, she behaves not only according to the 
command, "Wash these clothes, "' but also according to 
what happens as a result of the washing operation. The 
washerwoman and associated equipment make up a 
closed loop system. 


Whether it refers to an open or a closed loop, the 
block diagram possesses several important character- 
istics that deserve special mention. It must be re- 
membered that a block diagram is a functional repre- 
sentation of a physical system. Since the blocks re- 
present functional components rather than physica} 
components, a block may represent several physical 
units lumped together, or one physical unit may be 
Subdivided into several functional blocks. This com- 
bination and separation of physical components into 
functional units is based upon the operational relation- 
ships between the units. 


For instance, figure II-15 shows individual blocks for 
the control potentiometer and amplifier and a symbol 
for a differential. Actually, the potentiometer and 
amplifier are located within one control box, while 
the differential merely represents a method of wiring. 


Also in figure 11-15, the block representing the motor 
accounts for the relationship between shaft speed and 
control field voltage. But since the pump character- 
istics are important factors in determining shaft speed, 
certain pump features are actually a part of the motor 
block. In this example, the flow, Q,, is a simple 
function of pump speed. It is this simple function 
that is represented by y,. It is evident that an intimate 
knowledge of the behavior of the elements of a system 
is needed before a block diagram can be constructed. 
This aspect of the problem will be treated in some 
detail later. 


(b) BLOCK DIAGRAM ALGEBRA 


It is a comparatively simple job to derive the mathe- 
matical models (transfer functions) of the individual 
elements such aS Ya, Yy, Yo of figure I1-15. Each 
model describes the behavior of the corresponding 
individual element. To determine how these elements 
perform when linked together requires the derivation 
of a now mathematical model that describes the com- 
plete closed loop system of figure II-15. This new 
model is more complex than any represented by the 
individual elementary transfer functions, and must 
be examined to obtain a description of the behavior of 
the entire system. The ficld of controls system analy- 
Sis consists simply of a number of special ways of 
investigating the propertics of the closed loop. All 
of these special methods depend upon manipulating 
block diagrams such as figure II-15 into simple form. 
Such manipulations fall into the subject of block diagram 
algebra. 


As systems become more complex, they become un- 
wieldy mathematically. This situation is remedicd 


lI-8 


by a system of block diagram algebra that makes it 
possible to reduce even the most complex system to 
a single block. 


This is illustrated by the pump control system discussed 
above. 


The transfer functions Y,, Yy, Yg and Yp are the trans- 
fer functions of the forward elements of the system. 
Referring to figure 1-12, Y,*V,/Ve, Yy > 0,/v) , 
Yarn/n,;, Y,*Q, ; and since 


Q/Ve= (Vo/Vq) (0, Vg) (9/0, (G/N) = Yq Yq Yo Ye* Yn 
the four blocks of.the forward path may be reduced to 


a single block, defined by a forward transfer function 
Y»,, figurelM-16. Figure I-15 can then be represented 


as in figure II-17. 
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Figure II-16, Equivalent Single Block Representing 
Forward Path of Figure I1-15 


Note that the feedback element of figure II-17 is un- 
changed from that of figure II-15, because the flowmeter 
transfer function, Yp, is the only element in the feed- 
back link; consequently, it defines the feedback transfer 
function of the system. 


——— Forward Path ——- 
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Figure I1-17. Simplified Bloch Diagram of Pump 
Drive System 


The overall relationship between the output, Q,, and 
input, 4, , is obtained in terms of the forward and feed- 
back transfer functions as follows: 


The voltage to the amplifier was given by 


and since Ve = Qo/Yer » Vy ¥.Q, , and Vp = YQ, > 
these expressions can be substituted into (II-5) yielding 
Qo/Yo, = YQ, - YpQ, Rearranging the terms, 
Qo(1/Ypu ¢ Yp) = Y¥.Q, . Clearing fractions and forming 
the ratio of output tc input, the equation is 


Qy = Yo You 
(11-6) Qi, 1 Xp Vpu 


(11-5) and (II-6) are the two fundamental relationships 
on which all closed loop control systems theory is 
based. (II-5) is called the actuating error equation. 
It defines the "actuating error" (as represented by 
Vv. ) as the diiserence between the desired quuntily 
(as represened by V, ) and the output quantity (as 
represented by Vp). By direct substitution of the input 
and output, and by application of the forward und fced- 
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Transfer Function 


Actuating error = input- output x feedback path transfer function 


Error = input- output 


Closed Loop Equation: 


Output forward path transfer function 
Input 





"T+ (forward path transfer function) x (feedback path transfer function) 


Figure II-18. Fundamental Relationships for Single Loop, Closed Loop Systems 


back transfer functions, the closed loop equation, 
(11-6), is obtained. This equation shows that the output- 
input ratio of a single loop, closed loop system is 
Simply the product of all the forward element transfer 
functions divided by the sum of unity and the product 


of the forward loop and feedback loop transfer functions. 


Figure [I-18 summarizes these points. 


The single loop, closed loop block diagram of figure 
II-18 can be simplified even further. The reduction 
is based upon the mathematical relationships between 
output and input. 


Consider figure II-19. The input is R and the output 
is C. The closed loop equation is given by: 


Y 
II-7 ie et 
( ) R 1+ ¥,¥, 


where Y, and Y, are the forward and feedback transfer 
functions respectively. 


Rr C 
ofr 


Figure II-19. Single Loop, Closed Loop Block Diagram 


It is convenient to define 
Y , 
11-8 Ch ye yy, 
( ) le YY, 


Thus figure 11-19 reduces to a single block as in figure 
I-20. 


Cl. 


Figure I1-20. Single Block Equivalent of Single Loop 
Closed Loop System 


The advantage of this munipulation of a closed loop 
is that more complex systems such as that of figure 
MI-21 ure readily reduced to a cascade of single blocks. 





cha” THY ¥5 You,” TY, CLs) 16¥,Y, 


C 
Yeu Youg Yeu, 
Figure II-21. Reduction of Cascaded Closed Loops 


These principles are illustrated by the positioning 
control shown in figure II-22. Here an electric motor 
is employed as a valve positioning device by utilizing 
a potentiometer to feed shaft position back to the con- 
troller. When the control knob is deflected, a voltage 
is sent to rotate the motor shaft. The shaft rotates 
until the voltage from the feedback potentiometer cancels 
out the control knob signal. The block diagram for this 
system is shown in figure II-23. 


Using the relationships of figure II-18, the block dia- 
gram equation of this system is 


Y,Y Y,Y 
2 Ye . Ae Cs wher » AM 
(11-9) Fo Ye hte OF Gs VeoNe where Yer yA 


The hydraulic portion of figure II-22 is redrawn in 
figure I[-24 for simplicity. When the motor shaft 
rotutes, it pushes on the walking beam atB. This 
makes the walking beam pivot about point A and dis- 
place the valve spool away from neutral. When the 
valve spool is displaced,fluid flows to the cylinder, 
thus deflecting the control surface. The arm attached 
to the contro) surface pulls the feedback rod which is 
connected to ht walking beam at point A. Consequently, 
as the surface deflects, it rotates the walking beam to 
return the valve to neutral. This sequence is shown 
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Figure II-22. Surface Control Positioning System 
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Figure II-23. Motor Control System 
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Figure I1-24, Hydraulic System 


by the block diagram of iigure II-25. 







Valve Cylinder 


Linkage 


Figure I1-25. Uydriuulic Control System 


The block Y, is needed to account for the conversion 
of rotary motion (v) to linear motion (x,). The block 
¥, accounts for the conversions of surface deflection 
(5) to linear feedback displacement (xp). Included 


H-10 


in both Y, and Y, are conversion factors to account for 
the mechanical advantages of the walking beam. 


The block diagram equation of the hydraulic system is 


YY YY 
v_CN . od : 4 v 
“Te¥ 7Yen¥L or = YY, where ¥y Trey, bavi 


The complete block diayram of figure II-22 is con- 
structed by combining figures II-23 and II]-25. This 
is shown in figure II-26. 


8. 
(11-10) 2° 


Muking use of the definitions of (II-9) and (II-10), the 
system is reduced to a simple cascade, figure II-27. 


By defining Yop = Yo Yep Y; ¥,, the system is reduced 
to a Single block, fiyure I1-28. 
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Figure II-27. Surface Control Positioning System 
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Figure II-28. Surface Control System 


A block diagram form of great value in the analysis 
to be treated in later chapters is shown in figure I-29. 





Figure I1-29,. Unity Feedback Loop 


The block diagram equation for this system is derived 
using the principles of figure II-18. Referring to 
figure I]-29,E=-R-C and C- YE; therefore C/Y=R-C . 


Y 


(II-11) "Try 





VQ 


Equation (II-11) should be compared to (II-7). There 
is one essential difference between these two forms: 


the presence of a product of two different functions 
in the denominator of (II-7). Since (II-11) can be 


derived from (II-7) if the feedback transfer function 
is unity(Y,= 1), the system in figure I-29 is referred 


to as a unity feedback system. For this type of system 
the closed loop transfer function is simply 
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Figure 11-30. Unity Feedhack Control System 


FORWARD TRANSFER FUNCTION 
1+ FORWARD TRANSFER FUNCTION 


A common example of an inherently unity feedback type 
system is the hydraulic system shown in figure II-30. 


Since the valve is attached directly to the cylinder, 
there is a one to one follow-up. The sequence is as 
follows: control stick rotation displaces the valve 
spool relative to the valve allowing fluid to flow into 
the cylinder. The fluid flow is accompanied by cylinder 
displacement. As the cylinder moves, it carries the 
valve housing with it. Since the spool is attached to 
the stick (now held stationary), the cylinder will come 
to rest when it has carried the valve housing to the 
neutral position relative to the spool. 






Cylinder 





Figure II-31. Unity Feedback Hydraulic System 


A control system with non-unity feedback can be con- 
verted to the form of figure II-29 by the following 
sequence. For example, the system appears:as in 
figure II-32; its transfer function may be written as 
C 7 1 Y,YoQ 

R ¥, 1+ ¥,Y, 


(11-13) 





Figure II-32. Non-Unity Feedback System 


Replacing Y,Y, by y, the closed loop of figure II-33 
is obtained. 





Figure IIT-33. Unity Feedhack System 


After the closed loop is analyzed, it is necessary 
to multiply the results by 1/Y, in order to de- 
scribe the -.mplete closed loop behavior, i.e. 
C/R= (1/¥q) lyvcl +¥)). 


The unity feedback system is very seldom encountered 
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in physical networks, but it is very helpful in analyzing 7 d 
closed loop systems. air 


Figure II-37. Final form of Figure II-34 

Another useful diagram is that of the unity forward 

path systems, figure II-34. A symbol useful in developing block diagrams is the 
adder((4J). Application of this symbol is rather subtle 
since it is mechanized by the same type of apparatus 
as the differential (@).* One important application 
is in describing a so-called open loop-closed loop con- 
trol system figure II-38. Here the input is compared 
to a feedback quantity as in any of the closed loop 
systems described previously. In addition it is applied 
directly to the final control element (Yp) through an 
"open loop controller" (Yo, ). Here the adder symbol 
is used to show that signals are being added into the 
loop from an external source (Yo,). 





Figure [1-34. Unity Forward Path 


The transfer function for this system is derived by Figure II-38. Open Loop —Closed Loop Controller 
eliminating one loop at atime. Since the forward 
transfer function is unity, the first loop ls eliminated The adder is also used to describe positive feedback 
by applying (II-7) to figure II-34, 1.e.,d/c»= 1/(1+Y;). systems. lf the quantity fed back is added to the input, 
The resulting diagram is shown in figure II-35. the block diagram will appear as in figure II-39. 

The closed loop equation now has the form: 

Cc. Y, 
(11-14) vy 





Figure I1-35. First Step in Reduction of 
Figure II-34 





Applying (II-7) to the second loop, E's VeB 


1+ Y a Figure II-39. Positive Feedback System 


q, 
b Te Ye Yy 
- ntiny, 





A third application of the adder is shown in figure II-40. 
This is a parallel arrangement of blocks. The adder 
output is given by d= a’+b’+c’ , and since a' =ayY,, 
b’=bY,, andc’=cY,, d=aY, + bY, +cY, Note that 





Figure II-36. Elimination of Second Loop of 
Figure II-34 





Finally, : 


— Figure 11-40. Parallel Arrangement of Blocks 
1+ Y+*¥ 
qd. ; 





reas is eee 
ie Hy ¢Y 
as ¥3(T¥s¥.) SS See Lauer, i.snick,and Matson (Ref.3) or James, Ni- 
chols, and Phillips (Ref.4) for excellent descrip- 
and the block diagram is shown in figure II-37. tive material on mechanization of these functions. 
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the cascade or series arrangement of blocks, figure 
1I-12, represented a multiplication operation, and the 
parallel arrangement represents an adding operation. 


The location of the adder or differential can be shifted 
in a block diagram to aid in the simplification process . 
Figure II-41 illustrates this. 


Table II-1* is an extensive list of similar transformation 
pairs to be used in modifying and reducing complex 
diagrams. Note that item 10 was used to transform 
the cascaded blocks of figure II-12 into that of the 
single block of figure II-16. Also note that figure II-29 
was modified to figure II-20 by using item 16. 


To illustrate the use of this table,a complex multi-loop 
block diagram, figure II-42,is reduced to a simple 
single loop as follows: 


* This table was adapted from Reference 6. 
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(a) 


d= (aec’)Y¥ or 


d= (a+ 7) Y or 
d= aY+c 


(bd) 


Figure II-41. Equivalent Block Diagram— 
Moving of Sunming Point 


E,° A- B, 





y + E a + EB @ 
52) | Y, Y, 2 Oe a 8 
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Figure 11-43. Cascade Elencnts of Figure I1-42 


Combined 


: 2 a ¥, Y2 = (2 2. ts = 
oe @ 


Figue 1-44. Forward Loop 
Eliminate 


050 
C 
M, 


of Figure 11-43 
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pe ransterwation Original Diagram Equivalent Diagram ___Fquation | 


Interchiupe of Blocks 








2. Taterchange of summing points 










Rearrangement of summing points. 


Voving a summing point 
wiead of an element 








5. Moving a summing point 
beyond an element 






Moving u takeoff point 
beyond an element 








8. Moving a takeoff point 
uhead of a summing point 











9. Moving a takeoff point beyond 
a summing point 








Reacving an element frua 
a forward loop 








Inserting an element in 
a forward loop 







Eliminating a forward loop 







Removing an element from a 
feedback loop 








15. Inserting un clement in a 
torward loop 







16. Eliminating a feedback loop 





Inserting a feedback loop 


Table I1-1 
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As a Starting point, the series blocks are combined 
wherever possible (item 10). Thus Y, and Y,, ard 
Y, and Y, are combined. Figure [I-43 shows the first 
reduction. 


Next, the forward loop between ™; and A is simplified 
(transformation 13; see figure II-44). 


Figure II-45 shows the relocation of the take-off point 
and differential point of the main (outer) loop (trans- 
formations 7 and 4). At the original take-off point 
figure II-44, the input to the feedback block denoted 
by Y;9 was %,. The take-off point is now atC. Con- 
sequently, C must be transferred back to a, through 
the block 1/Y¥,Y, before being fed into ¥,5. Similarly, 
B,, the output of Y,,,must be transferred to R}= B,/Y,Y, 
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before being subtracted from the input V. Thus, the 
input to Y, is (V-B, - B,)Y,Y,- Substituting for f), the 
input is(V-B/Y,Y,-B,) Y,Y,=(V-B,) Y,¥,-B,- 
Since (V-B,) Y,Y.=M% it can be seen that this is the 
Same input to Y, as in figure 1-44. 


The three sets of cascaded blocks are combined in 
figure I1-46, leaving two minor loops separated by 
a single block, all enclosed by a major loop. 


The two inner loops are easily converted into single 
blocks (transformation 16) as indicated in figure II-47. 
From this, the final modified diagrams of figure I1-48 
are evolved. 


The final diagram allows the direct determination of 





Figure I1-45. Take-Off Point for Wg Moved to Right 
and Summing Point for By Moved to Left 





2 E% E;. mn A Cc 
B, 
| 
Figure I1-46. Cascade Elements of Figure I1-45 
Comb ined 
V : 2 EB _Y,Y,Ys n, ¥eYp A Y,Y¥,¥, Cc 
By 
Y,Yo¥6¥7 


Figure 11-47. Two Inner Loops of Figure I1-46 
Eliminated 
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Ya¥5¥io(¥q* Yo) 
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(b) 


Figure 11-48. Final Simplified Block Diagrams 
of Figure II-42 


the overall closed loop equationc/V. For this diagram, 
it is given by 


Y Yo¥a¥uVg¥q (Yq *¥o) 
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(c) EQUIVALENT BLOCK DIAGRAM 


The transfer function (Y) for many physical units can 
be derived directly by ordinary methods of analysis. 
However, it is often advantageous to construct block 
diagrams from the equations as the derivation proceeds. 
This not only helps in the derivation by indicating sub- 
Sequent steps, but also greatly aids in developing an 
understanding of the physical situation that the equations 
represent. The procedure is illustrated here by deriv- 
ing the transfer functions of a compound wound D.C. 
motor with a separately excited control field. 


Figure II-49a is a schematic representation of the 
motor. This can be simplified as in figure II-49b. 
In figure II-49b,resistances and inductances are lumped 
together in the respective branches of the circuit. By 
this simplification, analysis is facilitated without loss 
of specific information. It is important to note that 


Oo ee ©. aE a eee 


shunt field. 





The following assumptions are made for this motor 
analysis: 
a. The system is linear. 
b. Perturbations about operating points are small. 
c. There exists negligible coupling other than that 
intended between circuits, components, or voltage 
and frequency control systems. 
d. Negligible armature reaction effects. 
e. Negligible D.c, bus voltage variations. 
{. Negligible shunt field current variations. 
g. Negligible saturation of magnetic circuits. 


The motor constants are defined as follows: 
Total armature back EMF - E, 
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Total armature current - I, 
Total D.C. bus voltage - E,.. 
Total flux = ¢ 
Motor speed = 6 
Armature circuit resistance - R, 
Armature circuit inductance ~- L, 
Control field resistance = R;., 
Control field inductance + Ly, 
Total "effective" motor control 
field current = I;,. 
Total motor torque - T, 
Motor-load inertia « J 
Motor-load viscous friction - B 
Small perturbations are denoted by lower case letters. 
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Note: Increasing I, , Decreases Net Flux 
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(b) Reduced Diagram of (a). 


Figure I1-49. Motor Schematic 


Then, from motor theory, ky =Ki¢ 6. In addition to 
being a function of fixed and control field currents, y is 
also a function of armature current since the motor is 
compounded. Then, perturbations in E, are denoted by 


ok, { ob. oy ok, ; 
ee eee + 8 6 
(11-16) “a” 3} (Sh site) a6 


(No term duc .o fixed field current exists since its 
perturbations are assumed negligible.) Here it is 
important to note that the control field is a bucking 
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field; that is (9$)/(0I, ,) is by convention a negative 
number at the operating point. 


Motor theory also relates armature current to back EMF 
as follows: Eq .°E,*I,(R,¢sl,) where s«d/(dt), or for 
Small perturbations 

(11-17) i, : 


- ———_ 
R, (7, 8+1) 


where 7, -L,/R, 


Equations (I-16) and (II-17) indicate that the back EMF 
companent is a feedback system as shown in figure I-50. 





Figure II-50. Back EMF Block Diagram 


Motor torque is proportional to the product of the net 
flux and the armature current; i.e., Ty=Kotl,. 


Because of the series field, perturbations in ¢? area 
function of armature current 1, as well as the control 
field current I;,.. Consequently, for small perturbations 


oT a. a¢ . oT... 
II-18 t,=—# i —_——-1 —Aj 
( ) a oy | a1, °°" 3 It oa ter) 3 Iq a 


Figure II-51 is a block diagram of the motor torque 
equation. 


The important dynamic loads on the motor are simply 
motor-load inertia and damping, the latter caused 





Figure II-51. Motor Torque Block Diagram 


chiefly by windage. Therefore, T,-Js 6 +B. 


In perturbed values 


(11-19) 6. 1 
t, B(7ms+1) 
where % *J/B. 


Figure II-52 shows the speed-torque block diagram. 


t, 1 6 
B(7,8+ 1) 


Figure II-52. Speed-Torque Block Diagram 


The control field transfer function does not affect motor 
Stability; however it is presented here to complete the 
description of the motor '"'components." 


Input to the motor is the control field voltage Er... 
Because of the control field inductance L1,..,there is a 
time lag between the control field current I1,. and the 
control field voltage Er... 


i 2 “tem ‘ Kr ae toe 
Ce Le eS *Re oo Ta Stl 
where 7¢.n* (he gW(Re a) and Kp gt W/(Ry). This is 
shown in figure I-53. 








Figure I1-54. Motor System Block Diagram 
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Combining figures II-50, II-51, and II-52, the motor 
system block diagram of figure 1-54 is obtained. ‘he 
system transfer function is derived by combining equa- 
tions (11-16), (11-17), (11-18), and (II-19), and is shown 
by equation (11-20). 


(11-20) 
36 
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N(8) / D(s) = 2KG in which K is a positive constant 
and G is a function of s expressed as a non-dimensional 
ratio of products of the factors of N(s) and D(s). The 
roots of N(8) and D(s) are referred to as the zeros and 
poles, respectively, of the transfer function, and to- 
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Equation (I-20) is formidable to say the least. How- 
ever, figure II-64, which is its block diagram form, 
is fairly straightforward in that it shows in readily 
identifiable form the manner in which all of the electri- 
cal and magnetic entities of the motor interact to pro- 
duce the dynamic behavior defined in the transfer 
function equation (II-20). 


(a) THE TRANSFER FUNCTION 


In Subsection (b) of this chapter, the terms Y,, Y,, and 

Y, of the pump drive system were denoted as ‘the block 
transfer functions of the functional components. In Sub- 
section (c), a means of obtaining block diagrams from 
differential equations was discussed with the derivation 
of specific transfer functions considered incidental to 
the process. These sections were primarily concerned 
with developing block diagram abstractions of physical 
systems. An ultimate aim of this volume is to provide 
the designer with the basic tools required to perform 
experiments on paper. The block diagram abstraction 
is a necessary Step in this direction. 


To perform experiments on paper, the system designer 
must have available mathematical models of system 
components which 
1. Completely define the performance of the com- 
ponents, 
2. Can be combined with other models according 
to the procedure developed in Section II-3b to ob- 
tain inodels of a system. 
The transfer function is a form of mathematical model 
fulfilling the above requirements. This subsection is 
concerned with the derivation and interpretation of 
transfer functions. In the process of explanation, it 
is shown that the transfer functions can be combined 
and do completely define the performance of a system. 


To simplify the presentation, the characteristics of 
transfer functions are developed by the extensive use 
of examples. Transient and stability characteristics 
are discussed for specific systems, with pertinent 
generalizations noted without proof. 


Transfer functions of linear systems with constant 
parameters* can always be expressed as the ratio 
of two polynomials in the Laplace transform vari- 
able s .** Further, it is always possible to write 


* A linear system is one whose properties may be ex- 
pressed mathematically in terms of linear differ- 
ential equations. 


** The Laplace ‘transform is extensively used in this 
volume. The reader whois unfamiliar with thismeth- 
od is referred to Reference 5. 
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gether with the "gain" K they completely define the 
system. 


The simplest transfer function is one in which G is 
unity. Consider, for example, the potentiometer, 
gear box, and amplifier of the pump drive system of 
Subsection (a). The potentiometer is calibrated so that 
a certain setting representing a desired fluid flow rate, 
Q, , will produce a voltage, V,. Since the potentiometer 
is essentially linear, the transfer function is V,/Q, = K, 
volts/gpm, where K, is a constant determined by the 
reference voltage, V-er , and the calibration of the 
potentiometer. The potentiometer block is now given 


by figure II-55. 
Q, | | Vi 


Figure 11-55, Potentiometer Block 


The gear transfer function is simply the gear ratio 
Since inertias and friction effects have been lumped 
into the motor block. Denoting the gear ratio as Kg , 
the transfer function is then n,/n, = K, (dimensionless) . 


7 Ko - 


Figure II-56. Gear Block 


Ideally, the transfer function for the amplifier is de- 
fined by its gain, K, . For an input voltage, V; , the 
output voltage, V. , is equaltoK,\. The transfer 
function is K, volts/volt and is constant. It is quite 
possible, however, that the output voltage will not 
vary instantaneously as the input voltage varies; that 
is, there may be an elapsed time, or time lag, be- 
tween the change in input voltage and the proportional 
change in the output voltage. In this case, the G would 
not be unity. A detailed study of the amplifier would 
result in an analytical expression for G which would 
account for the time lag. 


For a simple example of a component which has a 
G function other than unity, consider the hydraulic 
amplifier shown in figure 11-57. An input displacement 
in the direction shown will open the valve so that the 
fluid wi!l flow in the direction of the arrows. The 
result is that the load is displaced to the right. From 


the figure, tr . ..llowing relationship can be derived:* 


* For input x,, pivot is at A; for output x,, pivot is 


at B 
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Figure II-57, Schematic of Idealized Hydraulic 
Amplifier 


Xy 
(11-21) Xy= Bas b)- x8 


The valve displacement x, controls the quantity of 
fluid flowing through the inlet tube. This also governs 
the velocity of the piston displacement. When the 
kydraulic fluid is incompressible, this relationship 
is defined by the equation 


(11-22 GXo . oy 
: dt v 


or, transformed, Cx,= 8x, where s is the Laplace 
operator and C is the piston velocity per unit valve 
displacement (constant for constant inlet fluid pres- 
sure). These two equations are illustrated in figure 
11-58. Combining the two figures yields the closed 
loop block diagram for the hydraulic amplifier, figure 
II-59. Note that the walking beam is broken up into 
two functional parts: the input function and the feed- 
back function. 





Figure I1-58. Components of Hydraulic Amplifier 


x, 





Figure 11-59. Closed Loop Diagram of Hydraulic 
Amplifier 


The output-input transfer function is given by 








X(S) abe b £ | ny l 
OS) Nes abs 
(11-23) Xo(S) ; Ki. 


x, (Ss) r,s ¢ ] 


where K,= (w+ b)/a, 7 = b/(aC). 
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Equation (II-23) is illustrated in figure 11-60. This 
diagram is functionally equivalent to figure 11-59, but 
note that the physical relationships are lost in figure 


I-60. 
(7,8 ¢ 1) 


Figure I1-60, Block Representation of Hydraulic 
Amplifier 


The transfer function (II-23) represents a single time 
lag. To illustrate this point, the response of the hy- 
draulic system to an input, x,, will be determined. 


(11-24) X_(8) = x4(8) 7 —i_ 


1 
3+ = 


A common type of input that is used to evaluate a sys- 
tem is the unit step function (heavy line in figure I1-6}) . 
That is, 


(11-25) x14(t) = 0 t <0 
-1 t>0 


The Laplace transform of (II-25) is x,(s)* 1/8, Con- 
sequently, equation (II-24) becomes 


(11-26) x,(s) = Ke —1 


A (s+ | 


The inverse transform of (I-26) is; x,(t) = K,(1-e"*4y), 
This expression is plotted in figure II-61 for two values 
of 7 where %, 7 %, . 
Notice that K, (the 'gain'') determines the ratio of the 
output to the input in the steady state. It is clear from 
figure II-61 that the quantity 7 determines how fast 
the output approaches a steady state value. A practical 
figure of merit is obtained by letting t-7, , then 
x," 0.633K, . So, 7y represents the time required 
for the output to reach approximately 63.3% of its 
Steady state value. It is convenient to call 7y the 
“time constant'' of the element. 


Evidently a system whose transfer function is of the 
form of (II-24) does not respond instantaneously to 
changes in the input. Since the time delay is repre- 
sented by a first order equation,the system is said 
to have a first order time lag." 


Another important observation is that the quantities 
7, and K, completely describe the first order system: 
K, describes the steady state performance, and% , the 
transient. In keeping with mathematical conventions, 
(II-24) is said to have a first order pole at eM Fe. 5, 


The linear approximation to a system never reaches 
a Steady state condition but only approaches it asymp- 
totically. Consequently, some figure of merit is needed 
to describe the speed with which the system approaches 
the steady st: tc value. The first order time constant 

T is an excellent figure of merit for systems that can 
be represented by simple transfer functions such as 
(I-23). For more complex systems a different cri- 
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Figure I-61. Response Curve of Hydraulic Amplifier 


terion of speed of response is needed. It has been 
found that a convenient one is the time required for 
the output to reach and remain within 5% of the final 
value. This time is referred to by several names 
such as damping time, settling time, solution time, 
and response time. By referring to the equation above 
it can be seen that x,(t)¥95% K, when t= 37. The 
response time RT: 37,. This is shown in figure II-61. 


The difference between the time constant (7) and the 
response time (RI) is that 7 is related strictly to 
first order poles whereas RT can be related to systems 
of any degree of complexity. This distinction will 
become more apparent later. 


The preceding discussion has developed the transfer 
function concept for systems of zero order (G unity) 
and first order, Gi= 1/(7s +1). The next simple trans- 
fer function of veneral interest in this sequence is the 
second order system. The characteristics of this 
system will be developed in terms of the accelero- 
meter shown in figure II-62. 


it 





Figure 11-62. Accelerometer Assenh ly 


This system consists of a mass (m), a damper (13) and 
a spring (k). y indicates the motion of the mass rel- 
ative to the frame and is called the output. . indicates 
the motion of the frame relative to inertial space and 
is called the input. The frame (F) is constrained to 
move in a vertical direction only. Any acceleration 
of F will cause a displacement of the mass w relative 
to F, thus giving an indication on the y scale. This 
is represented more simply in figure I-63 where x, in- 
dicates motion of mass relative to inertial space. 


In order to derive a transfer function relating output 


a 


y to input x, the forces on the mass are summed and 
Newton's law applied. The forces are 


Spring Force Po«-ky 
Damping Force F)= -8(dy/dt) 
Thus: 


F,¢ Fp = m(d?x,)/(dt*) or m(d?x,)/(dt?)+B(dy/dt)+ky =O. 
Replacing x, by y-x and rearranging the terms, the 
equation becomes 


2 2 
11-27 m HY. , gy = m 2X 
( 4 arr aaa ed dt 


Frame 







3 
Dumper 





Spring © 





Figure 11-63. Equivalent Diagram of Accelerometer 


Equation (II-27) is the differential equation of the 
spring-mass-damper accclerometer assembly. By 
dividing through by the mass m, the equation is rewritten 


(11-274) it2 ‘Rh at + rk y: qu? 


The coefficient k/m represents the square of the an- 
gular undamped-natural frequency of the system, 
wi .* Likewise B/m can be replaced by the product 
Jlw, , where © is the damping ratio. Then (II-27a) 
becomes 


11-28 d2y 2 d2x 
nrget itz | en GE tnt ys TE ea 


where a, is the acceleration of the frame. 


The Laplace transform of (II-28) yields 


(32+ 2lw—sS +we") y(8) © ax(8) 
Forming the rati: of output to input (displacement y to 


* See any elementary text on dynamics or servomecha- 
nisms, e.g., Lauer, Lesnick, and Matson (Ref. 3). 


J cp 





4 


94d ce 


5 


{ 


7 


acceleration a, ) gives the transfer function of the 
accelerometer for an acceleration input 


(11-29) denominator in denominator in 


dimensional forma non-dimensional form 


1 +> > s K, 
a,(8) 8 + 2fw.8 + aw “3. 


8 2 
aa ¢ gee 


where the gain K,= 1/w?. Factoring the dimensional 
form, (II-29) can be written as: 


NOMECOCORETS Ore TCCE Eon 
a (8) “(8+ Con* Jo,lt= 12) (e+ Co, > Jo,lt 


Consequently, (I-29) has a pair of complex conjugate 
poles at -{w,sJwV1-t4 . 


To determine the nature of the transient for this sys- 
tem, a step acceleration function is applied (by sub= 


stituting 1/s for a,;(s) in [II-29]) 
and the inverse transform obtained. Then 


y(t) = Ke E e-toatsin (oss 1-tFt+ tar EE J 


‘This response is plotted in figures II-64 and II-65 
for several values of ©. Each of the curves in the 
figure is typical of a range of values of ©. The sys- 
tems described by such curves are classified as 
follows: 

{>>1 Overdamped second order system. 

Cel Critically damped second order system. 
0< {<1 Underdamped second order system. 

C=0 Zero damped (neutrally stable) second order 

system. 


Second order systems with 0< (< lare of the greatest 
importance to the designer, so a special series of 
plots is contained in figure (A-1).* (Note that output 
is plotted versus the non-dimensional time parameter 
t/T, where T, is the undamped natural period: T, =27/4, .) 


These plots reveal that the systems with values of 
C between 0.6 and 0.7 have the lowest response time. 


* Since many of the illustrations used in this chap- 
ter are useful in actual engineering problems, they 
have been placed inthe Appendix for more convenient 
everyday reference. 
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As a matter of fact, it can be shown that the second 
order system with (~0.69 has the least response time 
for a fixed ~,. Consequently, in many problems this 
is a criterion for design. 





Figure I1-64, Three Types of Transient Response to 
Step Function Input for Three Ranges of the Damping 
Ratio C 


The value of ¢ in a second order system transfer 
function must often be determined from experimentally 
obtained curves. Figures A-1, A-2, A-3, and A-4 are 
useful for this purpose.* When { is close to unity, the 
overshoots are not clearly enough distinguishable to 
apply these charts. Consequently, a special plot is 
used, figure A-5. 


In the particular case where («1, (I-29) takes the 


form 
ys), 1 Ke 


ax(s) (s+)? (rs¢1)" 





where k,=- 7? and7°1/w,. The inverse transform of this 
system when a step acceleration function input (1/s) is 
applied is y(t) = K,[1-(1+ t/r)e"*/"] . This is plotted 
in figure II-65. 


° These curves are sel explanatory. However, special 
note must be made that these curves are approxima- 
tions and must be used with caution. 


sf K{1 -(1+¢ a, tenet | 





Figure II-65. Second Order System Response with 
Critical Damping (C= 1) 
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When {> 1, the characteristic equation (denominator of 
the transfer function in equation II-29) can be factor ed 
into two first order terms: 
y(s) . 1 ‘ Ka 
a.(s) J. 5 (7,8¢ 1)(7r,8¢ 1) 
x{ (5+ 7) (s*2,) : : 


1 1 
where 7° (ge ’ Lv) @ eee ’ 
w, (¢-{¢?-i] wy [0+ [c?- f] 
The time response of this system to a step acceleration 


function input is shown in figure II-64. It has the form 
of the sum of two first order transients. 


and Kia % %. 


It is evident from this discussion that second order 
transfer functions can be written in any of several 
forms depending on the value of ¢. Defining v«7,/7, 
(see figure A-6), 


(11-30) na race? 
a,(8) 8° + lu, 8+ w, 
(11-32) xs). —— 
a,(s) (s« r) (: r:) 
: y(s)_, 
(II-33) a,(s) a% 2 een 





(i) 


the various forms of first and second order system 
transfer functions and their associated time responses. 
The table includes several forms not discussed above. 
It is to be noted, for example, that the forms 1/(-7s + 1) 
and 1/(s*- 2(w,8+ w” ) correspond to systems whose 
time responses increase in value withtime. The 
divergent systems arise from the fact that the ex- 
ponential factors are positive. All of the mathematical 
manipulations performed above apply equally well to 
these diverging systems except that proper accounting 
of signs must be kept. 


Another point of interest is that multiplying the numer- 
ator or denominator of the transfer function by s has 
no effect on the convergence or divergence of the sys- 
tem. Only the initial and final values of the time re- 
sponses are affected. 


The preceding lengthy discussion on the first and se- 
cond order systems was aimed toward developing a 
familiarity with their many, essentially equivalent, 
forms and meanings. The most important fact to be 
understood is that the gains, poles, and zeros of the 
transfer functions completely define the behavior of 
the linear system represented. The charts and tables 
referred to in the Appendix are intended to help the 
control system designer determine and interrelate 
these parameters readily. Since nearly all linear 
system transfer functions can be reduced to products 
of first and second order factors, even the most com- 
plex system can be handled by means of the charts. 
The following examples will bring out some of these 
points. 


The preceding discussion concerned itself with single 


Reference 


Position 

= Inertial x xX, 
Space 

HG B, Yy 2X, ek 


x 
Ko = B, : 


322 Xo e xy 
n., 


(b) 


Figure I1-66. Accelerometer Mounted on Spring Damper Arrangement 


The relationships between all these parameters are 
summarized in Table A-1. Another table, A-2, sum- 
marizes methods of determining these parameters by 
measuring certain characteristics of the transient 
responses. 


The third table in the Appendix (Table A-3) summarizes 


11-32 


degree of freedom systems. A two degree of freedom 
case will now be discussed in order to illustrate some 
additional features of transfer functions. In this case, 
two independent transfer functions are required to de- 
fine the system completely. In figure II-66 the ac- 
celerometer is mounted on another spring-damper 
arrangement. Summing up the forces on each mass, 
the following equations are obtained: 


lL) td CLAY tos 


(Jed eo 


ly 


i 





d2x 


d4y,, 
TS) 


dy d2y 
Magia Sage Kaa" Magee 
(II-35) 
B dy, k day dy, d2x 
2a” ay2° "a . Bit ekiy,° at PVE 


By rearranging the terms and Laplace transforming, 
the equations are rewritten: 


(m,87 + Bog ka)¥_(8) - ma84y,(s) = -m,82x(s) 
(11-36) 
(By8+k,)¥_(8) ¢ (m,87¢ B,s¢ k,)y,(8) = m,82x(8) 


From these equations, the following matric equation 
is formed 




















(+ m,57+ Bos+ k,) ons? ae 
(Bs + k,) (ms2¢B. sek iy, as? 
from which 
-m,s? -m,8? 
¥3(8) | mys? ys + Bye kt 
x(8) m8? + B,s¢k, -ms" 
Bas+k, ms?+B.s +k, 
and 
m8? + Bos+k, - 0,8? 
y, (8s) B.8¢ ky as? 
x(S) m,s* + Base k, - as? 
Bas+k, m.s7+B,8¢ K, 





Expanding the determinants gives the transfer functions 
relating outputs y, and y, to input x. 


(II -37) 

¥2(3) | s?[-mo(m,s? + B,s* k,) +m,m 8?) 

xs) (m, 52+ B,s+¢ k,)(m,82+ B.S + k,) ¢m,8*(B,8+¢ ky) 
! 1 p78 3 2) *M, 2 2 

(11-38) 

y,(8) | s?(m,m,8" ? (mB, + m,)B.8 + (a, ? m,)K4) 


x(8)_ ” (a8? ¢B,a+k,) (m,87 + Bas +k) m8 "(B28 + k.) 


Collecting terms 
_ M2 2/8 
(11-39) _¥3(8),  K, * (F = + 
x(8) As‘ + Bs*+Cs?+Ds¢E 


Mey M\M2 2, b3 7 
¥,(8) rR 5 UAL ‘2? 


II -40 
( ) x(3) ” An*e Bs? + C2 +DseE 
where 


mina: 
Kk, 


As» 
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For this particular system, let 
m,* 100 slugs , m,=0.5 slug 
k,<5 lb/ft , k*3 lb/ft 


B,° 1 1b/ft/sec , By* 2 1b/ft/sec 


In order to determine the transfer function of the output 
(Y,) of the accelerometer versus the input (x), these 
numbers are substituted into (II-39), yielding 


¥3(8) — -.167 87(,28 +1 
II -41 

( ) (8) ‘3. 338¢ + 13.4352 + 20,4082+ .878¢ 1 
The fourth order characteristic equation is factorable 
into quadratics as follows: 


(ray Ya), = 16T8AG 28) 
x(8) (. 16682 ¢ .6688 ¢ 1) (2082 +. 20s «1) 
y2(8) -.16752(.28 + | 


HO” [ek Ya, GB) i] (a) 2B) 


The first quadratic factor defines a highly damped 
short period mode (¢,= 0.82, ,,* 2.46). The second 
mode is a poorly damped long period oscillation 
(C22 0.023, w, a,” 0,224). 


For a step acceleration function input (x(s)= 1/3) , 
(II-42) becomes 

: -.167s(.28 + 1) 
(11-43) Y2"8) * (Teest eas > 1) (ads? 0a 


The time function y,(t) is given by the inverse trans- 
form of y,(s). The inverse transform of (II-43) is 
obtained by a method of partial fraction expansion. 
By rewriting (II-43) in the dimensional form, it may 
be shown that 


(II-44) 


: -.01s(s ¢ 5) 
Ya(s) (8? + 4.038 +6.03) (84 + .01s ¢ .05) 


a om wee - 5 Gee eS 1 
(840 yay ~ joy J 1- C12) (BL yun jon 1-014) 


Ky K 
¢ ——- --—--~ =. ~ (Site io. et) 
(840 gu -Jmq, [1-0 34) i (S+0 0, t3Hy, 1-644) 
so that 
y,(t)=Ke! Huy en feat, Ke! ~Saem, don YIP It 


; CaaS LR @ Pea “Cau, , itn fiche 
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Figure II-67. Transient Response of 2 Degree of Freedom System 
where 6,5 ,2Ju_, “1- CP and Can, # Jury V 1- CF are the y,(t) = -.0095 e”?*°?*oos( 1. 41t+2.62)-.0082e"*°°**oos( . 224t- 087) 
roots of 'the first and second quadratics respectively. 
The coefficients are* Equation (II-45) is plotted in figure II-67. The first 
-.018(s + 5) $2.62 
K, ae (ae Ca, Jo, [lo C2) (aes Wg so, 2) » -,.00475 e 
a $1%s, : Joy, bettas 26 995 * Hn?) . “Oyo, + Je wy fi- oe 
7 = -.00475 e°52-62 
se Oyu, Joy] - oy 
K, ® Fe Pa Cre TRE eR = -,0041 e°4-087 
- WwW 
(Be Cag t Sond Sa CS Aen, ML [8s bp t Jaq yt oy 
- .O1s(s ¢ 5) 
K, = —--— + = -.0041 05-087 
: (89 Cyog,- doy (t- C2) (8? + 20 uw, St wy) ee 
~Cywy JQ, l- C7 
The final solution is given by transient mode is seen to die out very quickly because 
of its high damping ratio and natural frequency, while 
(11-45) the second transient decays very slowly because of the 


low damping ratio. Since it is a simple matter to obtain 
the response tiu.2 of the envelope of an exponentially 
decaying oscilluion from the single parameter (w,, and 
See Gardner and Barnes Page 154 (Ref. 5), for com- a relatively difficult one to obtain the response time of 
plete discussion of this method. the actual damped wave, the following approximate re- 


-{ ow, t -{ ws t 
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lationships are often used: ; 


0< (<1 'R slalas 7 
= 
Cs plies Poe 


{>> 1 RT 7S 


Thus the response time for the first mode may be 
approximated by RT,~ 3/(,#,,)*3/2.01* 1.49 seconds . 
That is, the first transient mode decays to within 
approximately 5% of its final value in 1.49 seconds. 
However, the poorly damped mode requires 600 se- 
conds to die down to approximately 5% of its final 
Steady state value RT.~ 3/(C,~, .)=3/0.005= 600 seconds . 
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In linear systems, the manner in which a system sub- 

sides or diverges is indicated by the conventions illus- 

trated by figure II-69. The diagram shows that: 
1. The statically stable system tends to return to 
equilibrium after being displaced (like an ordinary 
pendulum). 
2. The statically unstable system tends to diverge 
away from equilibrium (like an inverted pendulum) . 
3. The dynamically stable system returns to equili- 
brium jf it is statically stable. 
4. The dynamically unstable system tends to return 
to equilibrium, but it overshoots, reverses direction, 
and overshoots an even larger amount and thus con- 
tinues to oscillate at an ever increasing amplitude. 


Ce fsa! cos (w, V1-0) t+ vy) C,e" ant COB(w, Vv 1-C, te Po) =» y(t) 


Figure II-68. Response of 2 Degree of Freedom System. 


Although it is not physically possible for the system 
of figure II-66 to be described by such a transform, 
it is of interest for illustrative purposes to examine 
an equation of the form of (II-46). 


K s(s+ a.) 


: aay. har DOES TPS SE REP ee 
(11-46) ¥(8) = = 


+ 20 yo, 8+ a, 7) (8 ~ 20 gw, 8+ wy, 


The second quadratic factor has a root with a positive 
real part, leading to a divergent exponential e*Ss“a,°, 
The time domain solution is 


5. The statically unstable, dynamically unstable 
system has a tendency to diverge away from equili- 
brium while oscillating with ever increasing am- 
plitude. 


All of these characteristics are revealed by the trans- 
fer function. Referring to table A-3, it will be obsery- 
ed that when (<0, the system has a dynamically un- 
Stable mode while (>0 indicates dynamic stability. 
A first order term with negative 7 indicates static 
instability and a positive 7, static stability. 





(11-47) y(t) Cre Stns "cos(w, [I= Mtey,) +C ze" 68% 2 “cos(w, [1-0 2trH9) 





The two modes are given by items 15 and 11, respec- 
tively, of Table A-3. A representative plot of (II-47) is 
Shown in figure I-68 with, > ¢,, Hn? ny and C,*C,. 


The diverging oscillation is an example of an unstable 
mode. The word stability has been avoided up to this 


point because it means different things to different 
people. In this volume: If a temporary change in the 
input to a system cauSec a temporary change ip the out- 


put, the system is said to be stable. It is important to 
understand that this definition says nothing about the 


detailed behavior of the system. Thus it may approach 
Steady state conditions in a jerky or unsteady manner, 
but as long as it reaches a steady state it is stable. 





In all the transfer function examples, it should be 
noted that the transfer function is made up of ratios 
of products of first and second order terms. In fact, 
the transfer function of any system described by a 
higher order differential equation can be expressed 
as a ratio of products of first and second order terms 
Ss , (#7T8+1), and [s2/u,? 2(2C/w,)s+1). 


An examination of the transfer functions derived so far 
reveals that they are consistently of the form Y¥(s)K f(s). 
That is, there is a constant multiplied by a non-di- 
mensional function of s. The transfer functions Y(s) 
will usually U-cur as elements in a closed-loop sys- 
tem. The transfer function of units in the forward 
path of a system is designated by the notation :K,G, 
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where K, is a positive constant, and G is a non-di- 
mensional ratio of polynomials N(s)/D(s) such that 
Lim N(s8) = lin G(s) «1; thatis, G(s) is of the form 


a7, 2h 
(47, 8050s On, +1) oc 
(178 + 1) (478 +1) (G2. 2g at) oe 
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methods to be used make extensive use of graphical 
constructions involving transfer functions. The charac- 
teristics of the graphical representations of the transfer 
function are discussed in this section. 


Basically, the transfer function may be represented 
in two ways. The first is a plot of the singular values 
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Statically Stable, Dynamically Stable / 
Figure II-69. Stability Curves 


Similarly, elements in the feedback path are designated 
by the form sK,H. Thus the closed loop transfer func- 
tion can be written 


Go. i KeG = LK gKpGH to 
R I+K,K,GH " A TKKG KH Trey Y(s 
where Y(8) = K,K,GH. 


It is a comparatively simple task to obtain G and H in 
factored form as shown; consequently Y(s) is available 
in factored form and is easily interpreted in terms of 
performance in the time domain. However, when the 
Operation 1+ Y¥(s) is performed,the factors are lost. 
This is illustrated by the case of a simple servo in 
which the simple form y(s) « K,/(s(7,s+ 1)] becomes 


¥(s)/(1 + ¥(s)]= /((7, /K,)s*+ (1/K.)s+ 1) In the first 
expression, K, is a simple gain factor, while in the 
second expression it affects the roots. Consequently ' 
if it were necessary to work exclusively with the se- 
cond form, the denominator would have to be factored 
every time the gain K, were adjusted. In control sys- 
tem design, equations of very high order are common, 
and this process would be very time consuming. Thus, 
all the methods of control system analysis are directed 
toward determining performance by working with Y(8) 
instead of y(s)/[1 +Y(s)]}. 


(e) GRAPHICAL FORMS OF THE TRANSFER FUNC- 
TION 


The preceding section has shown that the system 
equation or transfer function defines the system per- 
formance in terms of its zeros and poles. The problem 
of analysis then resolves itself into one of determining 
the zeros and poles of the closedsloop equation. The 
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of s (the poles and zeros) as discrete points on a plane. 
The second is a plot of ¥(s) for all values of s. In 
either instance, similar information is available in a 
simple graphical form. 


The plot of discrete, singular points is considered 
first. The singular points of a transfer function occur 
for values of s equal to the poles and zeros. The 
plane on which these values are plotted is referred 
to as the s-plane. 


Since the poles and zeros can be complex, pure real, 
or pure imaginary numbers, the s-plane plot for an 
illustrative case might appear as in figure 11-70. This 
figure defines all the characteristics of the s-plane 
plots. 


jw 


-- Ty x indicates a zero 

Gl, @ indicates a pole 

wy fi - (2 The poles and zeros of y(s) 
plotted here are 
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Figure II-70. Poles and Zeros of Y(s)s 
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As shown in Section II-3d, the poles and zeros deter- 
mine the type of time response the system will have 
to an input. Consequently, a table can be constructed 
relating the s-plane plot to the time response. Table 
II-2 is such a compilation for a second order system, 


Table II-2 indicates that the type of response desired 
can be controlled by specifying the location of the poles 
of the closed loop transfer function. For instance, 
suppose that for a unit step function input, it is desired 
that the height of the first overshoot of the output be 
less than 1.15: i.e. h/tH».15. From figure A-2, any 
value of the damping ratio ( greater than or equal to 
-5 will satisfy this condition. 


From figure I-71, ¥*cos"!{ »cos"!,5= 60°. Therefore, 
excluding all poles of the transfer function from the 
region to the right of the 60° line as shown in figure 
II-71 ensures that (¢ >.5. 


If the problem is to make the transient subside to a 
negligibly small value in a certain time interval, the 
quantity {», = 3/rT must be controlled. This is done 
by excluding all poles from the shaded region of figure 
Il-72. 


Another important feature is revealed in figure II-70. 
In particular, a root in the right half of the s-plane 


Location of Poles of 
System Equation in s-Plane 
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Figure II-71, Poles Excluded from Shaded Region for 
(>0.5 


corresponds to a root with a positive real part. Previ- 
ous discussions showed that such a root led to a diver- 
gent response. This is also indicated in Table II-2. 
Obviously, then, a requirement for a stable closed 
loop system is that it have no poles in the right half 
plane. 


The s-plane is also very useful in determining equation 


Time Response of Modes 


Table II-2. Effect of Damping Ratio (C) on Poles and Transir-t Response when System 


Equation has the Fora f(s) - 


xi (s) K 


(82/w2)+(20/w,) sel 


X,(S) = Input = 1 
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coefficients such as those given by K,, Kz, Ks, and 
K, in (0-44). Consider a simple closed loop transfer 
function given by 


C , K x - geo 


BR. das (8 + wis w*) T 


which for a step function input becomes 


Cc. K_x 
s(s + 4)( 82+ Wwase wg) 


or 
K « 


The time solution is given by * 

C(t) =K,¢ Ke? ¢ Ko (“Cent don vag t ‘ K 0 (Cen due 1-0%¢ 
where 

(11-48) 


K.= . 
1 (84 2)(8+ Con= Jon] 1-02) (84 Con? Sond let 2) 


K« 


K,« 
2 '8(8+ Cw, Jo, J1-02) (B+ Con + Jo, f1-C7) 


K « 


K,° 
8(8+ 7) (B+ Cw, * jo, J1-¢ ) 8" 8,° “Cw, + jw, [1-03 
Ke Ks 
4 s(se dy (8 ; li-¢ 2 
8(8+¢ £)(8 Cw, jw, 1-¢°) ge 85° “Cw - ja, J1-¢ 
ry 


By making the indicated substitutions for s, (II-48) 
becomes: 





8e 6° -4 
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Figure II-72, Area of Exclusion to Obtain Speci fied 
Minimum Damping (Cw) 


YJ 


By- 52" ( -1/7* (wa- Jon F1- C7) in equation (1-49). 
In a similar manner, the vector (-1/7* Con + Joni1l- 02)z 
8,- 83 18 drawn in figure II-74. This figure shows that 
“1/7 * Cone Jogi l- Cl and -1/7r + fw, + ja, I< v? are 
complex conjugates. Therefore, the product of these 
two vectors is a real number: 


e K_x 
a (-+) -F + lone Jonfl- (2 ? 


K, is obtained by measuring the lengths of two vectors 
3, and 8, ~ 8,and carrying out the indicated multiplication 
Ka* (-Kx)/((sy]. 184-52 /22_ 

The product is negative and the vector K, points in the 

negative direction along the real axis. 





Each of the factors of K, is shown in figure II-75. 
K, may be expressed as K,= (Kx)/(|Kgle*%3) where 
[Kyl = [8g1/S.- 8,/ 182-831 and d1= by+ dye ds ° 





K 


) (Sey > Jer, |1- 2 tax fo 1- ) 


(11-49) Ky" 


j 


K,= 


K, ° 


(4) (-++ La, = joel) CF Lum + Jan di- 0? } 


(toys Jo, {1- 67) (-to, Jo, {2- 07% t)(-boa Jo, {1- C+ Cw, + Jo, 1- “4 


e = 1-7) 
. (~twn - jon Ji - 08) (-kon Jon {1- 07+ ) (-kon- Jun{t- F ton Jon] - 0) 





In Sub-section (d) the K's were obtained by substituting 
the numerical values for each of the parameters ( {, 
w,, etc.) in (II-49). K,is evaluated in this way very 
easily; K, = (Kar)/w? = K. K,,K,,and Ky ae Somewhat more 
complicated and graphical computation is advantageous 
in these cases. This car be done by utilizing the s-plane 
plot as shown in the following explanation, 


The poles ( a" 0, 3,8 -l/7 , S97 ~Cw, + jo,f1- CF , and 
Sy + = le, - ju, IT- (7) of the transfer function are 
plotted on the s-plane in figure II-73. Also shown 
are the vectors representing these poles. A vec- 
tor is drawn from s, to 5, representirtg the factor 


* See Gardner and Barnes, Page 154 (Ref. 5). 
II-28 


Similarly, Kj is plotted in figure II-76. Note particu- 


larly that K, is the complex conjugate of K,;. So 
IK3 l= [Ky] and dxs* -&:. 


The complete time solution C(t) is now 


C(t) = KI le a 
Royeretecy 


+IKgle! “berg Send OP) t-JeQ 


_t 
@ T]k,|e (tention sI-O'dt- dong 


where |K,! © (K«)/|K,| and |K,| = (Kx)/|K,| . Since 
K, and K, are complex conjugates, 


ae ee ee ee ee ee ee ee ee ee ee 


rr) Ol FG 


sli‘ a. rn ee 
Pelbcld ch Jj www www ww 
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= Lay + Jo, fl - C2 #8, 


By Baek + Con - Jomfl - ¢ 
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Figure II-73. Vector Plotof Ce 


K «x 
a(s+4)(52+2la, sew?) 
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Figure II-74, Graphical Solution for K, 





IK,]e “Sys ol -Co,tsonfi- ort IK, ely, t-tea-don fier 

[Ky | (eo ~SOus tl kant don BOE, g eSeyrel-Kon-Son fi-8)t) 
iK,| 7 See® [el (madlt-tF-oy) 4g “J (watli- 0-045) 
Referring to figure II-77, it is seen that the term 
fend (oye -w, fi-c8ty v9 Sty -o,J1-688)) -2 £08 (45 f1- Cas) 

is the sum of two unit vectors. Consequently, only 
figure I-75 need have been constructed to obtain the 
amplitude terms of the time response. 

The time response is: 

C(t) = Ke K,e"Fs fei e ~n%oos(c, fi-cie = ty!) 


Note that this value checks with the inverse transform 
given on page 343 of Gardner and Barnes (Ref. 5). It 


is interesting to observe that the vectors K3 and 
RK, ~— fall in the left half of the s-plane. Because of 
this, it might be assumed that the amplitude of the 
last term of the time response should be preceded by 
a negative sign. However, this would be incorrect since 
the sign is taken care of in the term cos(wn/ 1-C*t-¢x4). 


This example had no zeros in the transfer function. 
To illustrate the procedure of graphically determining 
the transient response amplitude terms for a case in 
which the transfer function has zeros, the coefficients 
of (11-44) will be determined. The graphical solutions 
fork,, Kj, K sand K,of (IJ-44) are given in figures II-78 
and II-79. Only K, and kK; are obtained since K,is the 
complex conjugate of K,, and K,is the complex con- 
jugate of K3. The special point to observe in this ex- 
ample is that zeros are treated in the same manner 
as poles, with due caution being taken to keep the alge- 
braic signs correct. 
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Figure I1-75. Graphical Solution for Ky 
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Figure II-76. Graphical Salution for K, 
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Figure II-77. Conjugate Unit Vectora 


Following this procedure, the time solution for (II-44) 
is obtained by substituting these K’s into the proper 
equation. Since 


y,(t) ° K e723. Ol t+) 1.41t, Ko" 2 01t-J 1. 41t 


+ Kev 008t+s.a24t , 9°. 008t-J. a2t 


substituting the values for the K's from the graphs, 
y,(t) becomes: 


y5(t) 
(-.00475e 42: 632 @72- Oites 1.41¢ -,00475e -§2. 62 ge” 2- Oit-Jj1. ait) 


+ (=. 0041e 71-087 9>-008t+s. 224t _ QQ 41¢ 5-087 g-.008t-J. 224t) 


This may be rewritten as: 


B, - 8) = -2.01 + $1.41 +5 «3, 300) 25. 2° 
8) - 82° -2.01 + jl.41¢2.01¢j1.41> 2.82e500° 
Bi - 53 = -2.01+ 11.41 +, 005 - J. 224 = 2, 34e/ 140. 8° 
By - 5 > -2.01 ¢ J1.41 ¢ 005 + J. 224 = 2.59e) 140.0° 





B, + -2.01 + J 1.41 © 2, 460) 148. 2° 


-5 -4 -3 
-.01(8,) (5, - 5,) 
(8, - 52)(8, - By) (8, - 53) 
~.01(2. 46e/ 145. 2°) (3, 30e/ 25. 2°) 
" (2.820) 00°) (2. 59e) 140.9°) (2, 340/149. 5°) 
© -.00475e71210° . - 00475e7/ 150°. -. 00475) 2. 62 
K, * -.00475e-12. 62 


K,- 


Y¥4(t) © -.00475e "2-01 
(@4( 2. 62¢1. 416) , 975 ( 2.6241. 41t)) 
-,0041e°: 005t 

(e J (+. 087+. 3224¢), 9 -5(-08%. 224t) ) 
or 
¥,(t) = -. 00950 “2 9!* cos(1, 41t + 2.62) 

-. 0082¢ “95 cos(. 224t-. 087) 

which agrees with (II-45). 


The second basic way of representing the transfer 
function is to plot Y(s) as a continuous function of 
s. Since s is a complex variable, such a plot for 
all values of s would require four dimensions. How- 
ever, very useful representations can be obtained by 
allowing s to be a pure imaginary ( jw ), thereby 
restricting the plot to two dimensions. 


Y¥(jw) is in general a complex number. Its value for 
any fixed w can be expressed as a magnitude (called 
the amplitude ratio) and a phase angle. Two con- 
venient methods of graphical representation will be 


described in this subsection. In the first, the ampli- 
tude ratio is plotted at a given phase angle on a polar 


tj 
B, = -2.01¢j1.41 
8; = 83 


ol 
83° -.005 + j. 224 


S,= -.005 - j. 224° 


$+ -2.01-j1.41 
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Figure I1-78. Graphical Solution For K, of (II-44) 
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Bo = -A,* -5 
ri inc No 


-§ -4 
-.01(83) (33 fe Bo) 
(By - 82) (85 - 8.) (85 - 84) 


-. 01(. 224e391°) (5@52- 8° 
(2. 59e439- 1°) (2, 34¢4329.8°) (, 4gge) 90°) 


K,= 


e - ,0041e°1365°. (0041e-15° 


© - ,004le-J- 087 


K, = -.0041e+). 087 


Chapter II 
Section 3 


B,=-2.01+j1.41 


+1 
85° -.005 + j. 224 


8, ° -.005 - j. 224 


-1 


84° -2.01 - jl. 41 





Figure II-79, Graphical Solution for Ky and K, of (II-44) 


plot with w as a parameter. In the second, a con- 
venient function of the amplitude ratio is plotted versus 
frequency on semi-log paper with the phase angle being 
plotted in a similar way. 


For the purposes of this subsection, the selection of 
s« jw is essentially a matter of convenience. However, 
there is a definite correlation between Y(jw) and part of 
the time response of a system excited by a sinusoidal 
input. This correlation wi:l be considered in detail. 


In the development of the graphical representations a 
procedure similar to that used previously will be em- 
ployed. The explanations will be made for actual ex- 
amples, starting with very simple cases. 


The first graphical representation discussed will be 


the polar parametric plot commonly referred to as 
the Nyquist diagram. 


Consider the system which has the transfer function: 
K 
(11-50) K G(s) = S(78+* 1) 


if jw is substituted for s, where -w¢ wea, 


K 
(11-51) K,G(Jo) = Toor 1) 


Figure II-80 shows that both jw and rjw +1 may be 
represented as vectors. 





Figure II-80. Vector Representations of jw and Tjw+l 


Writing K,G(jw) in a form to take advantage of this 
fact, (II-52) is obtained. 
(II -52) K G(jw) = Arena SEES 
$1 oy 
r,e ree 
where ri°@, ry {rte 1, >, 2 90°, d_= tan™! TW 
So that 





(II-53) K G(jw) « Kg S(¢, 45) 


wr 224 1 
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Equation (II-53) shows that KG( jo) can be represented 
as a vector with a magnitude K/(«[7 22+ 1)and a phase 
angle -(¢, + 42). The magnitude is commonly called 


the amplitude ratio. 


Plots of (II-53) for K= 10 and K= 2.5 with 7=.5 are 
drawn on a polar chart in figure II-81. 
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Figure I1-81. Nyquist Diagram of Open Loop 
Transfer Function 


For illustrative purposes the vectorsfor w=1,2 and 
w*2 are shown. 





KN(s) 
° sD(s) 





| ¥(s) 





Notice that rectangular coordinate axes have been 
superimposed upon the polar plot with the axis of 
imaginaries oriented along the -90°, +270° line and 
the axis of reals oriented along the -180°, 0° line. 
The vector drawn from the point -1+ j0 on this coordi- 
nate axis to the locus is the vector 1 +K,G(jw). Since 
the closed-loop response is given by 


C(s) K .G( Ss) 


(11-54) R(s) 1+ K,G(s) 


C(s) , |OP| 4a . | : 
fat” tel ae ie Oe 
This relationship makes it possible to obtain the closed 
loop magnitude and phase relationships from those of an 
open loop Nyquist plot. 


Particular attention should be paid to the effect of the 
constant K in figure II-81. The phase angles are in- 
dependent of the magnitude of K. Consequently, the 
shape of the curve is unchanged by changing K. The 
only effect of K on the polar plot is to change its scale. 


Another important feature of the plot is that it is sym- 
metrical about the real axis, The reason for this is 
that 2 ¥(s),.;,, changes sign with w, while the squaring 
process required to establish |¥(s)|,.,, eliminates the 
effect of a negative '"'w," 


Higher order transfer functions are plotted in the same 
way. The procedure is to set s=* jw and to calculate the 
magnitude and phase angle of the transfer function for 
each value of w from zero to infinity. Table 1-3 is a 
summary of locus plots for some common transfer 
functions. In this table only the parts of the loci corre- 
sponding to 0< w< + are plotted for simplicity. 


One part of every Nyquist plot that is of special interest 
is the "low frequency end.'' Table II-3 shows that as the 
frequency, ~, approaches zero,certain loci take on 
infinitely large values and approach an axis a8 an 
asymptote (Table II-3d and II-3f). Loci exhibiting this 
behavior correspond to important classes of control 
systems. The three most important ones will be dis- 
cussed in some detail in Chapter IV. Figure I[-82 
shows the characteristic loci for each class and the 
corresponding form of the transfer function. 





Figure II-82. Special Loars Shapes 
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In the preceding discussion, the transfer function 
ly(s)| sey. has been treated as a convenient abstract- 
ion. However, the part of the locus corresponding w 
0 wé+® can be obtained physically by applying a 
sinusoidal forcing function to the system. The differ- 


ential equation then becomes of the form 


(11-55) 
dx an ee X,sin wt rr) 
Baca * Gp. late! i td t&>* AgSlN w (Og weg + ®) 
Transforming, 
qh a 


(11-56)  (&,8%+ ay. 8" 1 ¢----¢a,)x(8) = 


Locus on the 
ee ee 
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X, “a 


Expressions of this type can be inverse transformed* 
as follows: 


x(8) = 


eet 





(11-57) x(t) = PAdT —— 
: = s+ : sooly.-- 6] 
° 


8° jw 


Kes r K,e%ats---- ¢ Keen? 


* See Ref. 5,page 159. 


Locus on the 
Complex Y¥(8) Plane 








w~ Indicates Direction of Increasing Frequency 





Table II-3. Some Common Transfer Functions and Their Locus Shapes 
on the Linear Plot 
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where I indicates "imaginary part of." 


The motion x(t) described by this equation consists of 
a sinusoidal oscillation of amplitude X,/n,. and fre- 
quency w, and a transient determined by the sum of the 
exponential terms K,c°:* , K,e*s*, etc. The sinusoidal 
oscillation is described by 


ke 
a : a-l,... 
8 i ge” te: > ol 


=] 
sd 8° jw 
? 

K 
nnn | Sin wt 
= B® “a-1 gio ly. .-4] 

sejw 


where K ©X /a andO<ws+o. The term in the brackets 
determines the amplitude and phase angle of the sinu- 
Soidal response and is recognized as the transfer funct- 
ion Y(3) | ga). of the system. This result applies to 
linear systems of any order of complexity. It shows 
that the transfer function can be obtained from the 
physical system by applying a steady sinusoidal input 
and separating the steady output oscillation from the 
transient terms. The stability of a system has no 
effect on the validity of these results, although, prac- 
tically speaking,it sometimes is difficult to separate the 
sinusoid from the "transients" in unstable systems 
without the application of special techniques. 


The second graphical representation of Y(s) to be 
discussed is the logarithmic or Bode plot. The cal- 
culations required to construct such a plot point by 
point are identical to those discussed above. For the 
simple system 


(11-59) K,G(s) = 


ee 
u(7TS + 1) 
the form (II-53) is derived, and the amplitude ratio 
K/ (afr 27 ¢ 1) and phase angle -(¢, + ¢,) are plotted 
independently versus the angular frequency w on semi- 
logarithmic paper. The w is plotted on the logarithmic 


scale, and 20 loki9 (K/(wf[7 202 ¢ 1))and -(¢, ¢ 2) are 
plotted on the linear scale as in figure II-83. 


The notation 20 log ,)( ) is referred to as the log- 
modulus or La,and performing the indicated operation 
results in a number in decibel (or db) units (see figure 
A-20). One advantage of this procedure is that ampli- 
tude ratios can be plotted very simply. In the example 
chosen (see [II-51), 


(IT-60) | - La K -La| jeol-Lalrj co «1 | 


a 
jw(7Jw+1) 
These three terms are plotted in figure II-83 as curves 
A, ®B, and C and are summed as curve D. 


The dashed sloping line marked(B)is the Luaji/( jw)| curve. 
Since the plot is done on logarithmic coordinates, it is 
a straight line as shown. In a plot of this type,a change 
in w by a factor of 10 is called a ''decade''; a change by 
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a factor of 2 (doubling its value) is referred to as an 
"octave.'' Consequently, since the slope of the fine is 
~20 db per decade, the curve is said to "attenuate" at 
a rate of 20 db/dec. or 6 db/octave. That is, 
tm|1/(ja) | = 20 10g, 1/@=-201l0g,9,and each time the 
frequency is increased by a factor of 10, the magnitude 
of Lm|1/(j«)| is decreased by 20 db. The 20 db/dec. 
attenuation rate is true of all s* jw terms in the de- 
nominator of a transfer function. An s-= jw term in the 
numerator plots with a positive slope and is said to be 
amplified at the rate of 20 db/dec. (or 6 db/oct.). The 
attenuation and amplification rate will be specified in 
terms of decades in this volume. If the s= j. term is 
raised to the n*" power, the slope is 20n db/dec., i.e., 
Lm | jut" | = 20 10g1y wt "+t 20 n logi0 w, 


The (7jw+1)-! term of the transfer function is shown 
by curve (C) in figure II-83. This curve approaches 
two straight line asymptotes. The relationships for 
establishing the asymptotes to the true curve are as 
follows: when jw7r<<1, 





(II-61) al ~ Lm 1 = 0 db 
jwr?l 

When jwr >> 1, 

(IT -62) Jure I Jw 








Equation (II-61) establishes a horizontal line at zero 
db, and (II-62) establishes a straight line sloping at 
-20 db per decade. The asymptotes intersect at 
the frequency where w= 1/7 ; (wr=1), At rwe 1, 
Lm|1/(jwr+1)] tm 1/f8x-3db. Therefore, the true 
curve lies -3 db from the asymptote at this point. 
At one octave below the "break point," 7-5, Therefore 
Lm|1/(ja7¢1)| = Lm 1/(f7 521) = im 1/( 1.25) +1 db. 
The actual log modulus value is then 1 db below the as- 
ymptote. Atzvw=2, (one octave above the break point), 
‘Lm(1/ [87+ 1)=Lm( 1/[5)*-7db , however, at7we2, the as- 
ymptote is at-6 db. Therefore, the log-modulus curve 
lies one db below the asymptote at this point. 


The complete log-modulus curve, pD , for the transfer 
function (II-59) is obtained by simply adding the three 
curves A, 8, and C in accordance with (II-60). 
The same result is also obtained by adding the asymp- 
totes for each of the factors of the transfer function, 
line bo‘a', and then sketching in the true curve bc a’, 
Notice that the break point is still at «w= 2, (7«= 1) and 
that the 3 db and 1 db departure characteristics still 
hold. For any changes in the value of K,the db scale 
need only be shifted up or down depending on the nature 
of the change of K. Evidently this procedure is general 
for first order terms and may be summarized as 
follows: 

1. Establish break point («= 1/7) on the zero db 

line and draw in the asymptotes. 

2. At the break point, draw a line sloping down- 

ward to the right at 20 db per decade for a de- 

nominator term, and upward to the right for a nu- 

merator term. 

3. At the »1 -ak point, spot a point 3 db below the 

zero db line for a denominator term and above 

the line for a numerator term. 

4. At one octave above and at one octave below 


eJet eyes _IJ v_J ELS oe LI tJ LILI LI LI LI CF 


the break point, spot points 1 db distant from the 
asymptotes, below for a denominator term and 
above for a numerator term. 
5. Sketch in the log-modulus curve, using the asy- 
mptotes and the three points. 


The phase angle curves for the transfer function are 
also shown in figure II-83; the phase angle varies 
from -90° to -180° as the frequency increases (solid 
line). This phase angle curve is the sum of the two 
curves arising from the (jw)"! and(.5jw +1)°! factors. 
The (jw)-! term plots as a constant - 90° phase angle 
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(curve E). The (.5jw+1)-! angle factor approaches 
an asymptote at 0° and another at -90°, its midpoint 
(45°) being determined by 1/7. Figure A-7 is in- 
cluded in the Appendix in order to facilitate sketching 
the curves. It is to be noted that a factor rs ¢ 1 in the 
numerator produces a phase curve starting at a 0° asy- 
mptote and approaching +90° at high frequencies and 
of the same shape as the denominator factor. 


Many of these same principles can be used in plotting 
second order terms in logarithmic form. However, 
since the second order factor is a function of two in- 
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Figure 11-83. Bode Diagram of Open Loop Transfer Function K G(s) = 
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Figure II-84, Bode Diagram of K,G(s) 


dependent parameters ¢ and, plotting is slightly 
more complicated. Figure I-84 points out some of 
the special features of these terms. The two key 
characteristics are the -40 db/dec slope at high fre- 
quencies and the phase shift of 180° . 


Several charts have been prepared to aid in the con- 
struction of Bode plots of second order factors. After 
the break point and the -40 db/dec asymptote have been 
established, figures A-12 and A-13 are used to locate 
the peak when one exists. Figures A-14 through A-17 
are charts which give amplitude ratio departure from 
the asymptotes and phase angle. For most purposes, 
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a satisfactory sketch of the amplitude curve can be 
completed using only figures A-12 and A-13. How- 
ever, figures A-14 and A-15 can be used to aid in the 
construction of more accurate curves. Values of the 
amplitude departure from the asymptotes for discrete 
frequency ratios w/o, are read by proceeding up and 
down the ordinate representing the value of 4. The 
Same procedure is sollowed when using figures A-16 
and A-17 to construct the phase angle plot. 


Gain (K,) adjustments are made by shifting the db 
scale as shown in figure II-84. Consequently, the 
amplitude curves are nearly always plotted for 


ry 


ee ee ee ee 
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K,= 1 (Odb) , and the 0 db line.corresponding tq the 
true gain,marked in later. If the gain (K,) is greater 
than unity, the true 0 db line occurs below the one 
used for plotting; a K, less than unity places it above. 


It is clear that any number -of'factors of any order 
may be added on Bode plots ‘to achieve a complete 
transfer function plot. Since it.is so simple to plot 
first and second order terms, the transfer functions 
are always factored accordingly. This avoids tedious 
computations of amplitudes and phase angles of com- 
plicated transfer functions. 


Table A-4 is a summary of forms of the transfer 
functions encountered in system analysis. In the last 
column showing the Bode plots of the factors, only 
the asymptotes to the log-modulus curves are shown. 
For items 7, 8, 9, and 10, the 3 db and 1 db de- 
parture relationships apply. For the second order 
terms, items 11, 12, 13, and 14, the exact shape 
of the phase angle curve and the log-modulus (am- 
plitude ratio) curves dependson the damping ratio { . 


Notice particularly in Table A-4 that the asymptote 
curve breaks upward for all numerator terms (items 
1, 2, 3, 7, 9, 11, and 13), and all denominator terms 
show a downward break of the asymptote. Note also 
that this fact plus the phase change indicate whether 
the zeros or poles are in the right or left half of the 
S-plane. That is, a phase curve tending to go in the 
same direction as the amplitude ratio curve (items 
7, 8, 11, and 12) shows that the zeros or poles are 
in the left half plane, while those that go in the oppo- 
site direction indicate zeros or poles in the positive 
half of the s-plane. 
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Bode (Ref. 8) refers to systems that contain no poles 
or zeros in the right half plane as minimum phase 
systems. If any poles or zeros exist in the right half 
plane, the system is non-minimum phase. Following 
this lead, those factors that represent poles or zeros 
in the right half s-plane are generally referred to as 
non-minimum phase terms; all others, including poles 
and zeros on the imaginary axis, are minimum phase 
terms. 


The following general conclusions can be made con- 
cerning the interpretation of Bode diagrams: 
1. Asymptote slopes must always be either zero or 
some integral multiple of + 20 db/dec. 
2. The change in slope of the asymptotic plot ata 
break point indicates the order of the pole or zero 
that exists at the break point. 
3. A positive change in slope corresponds to a zero. 
4. A negative change in slope corresponds to a pole. 
5. a. The location of the break point of the asymptotes 
indicates the location of first order poles and zeros 
on the s-plane. 
b. The location of the break point and the departure 
from the asymptotes indicates location of second 
order poles and zeros on the s-plane. 
6. When phase and amplitude curves change in the 
same direction, a minimum phase term is indicated. 
7. When phase and amplitude curves change in oppo- 
site directions,a non-minimum phase term occurs. 
8. When the slope of the amplitude as w ~ gis -20 
db/dec, the system is of the zero position error type. * 
9. When the slope is -40 db/dec asw ~ 0,the system 
is of the zero velocity error type. * 
10. When the slope is -60 db/dec as» ~ Ofhe system 
is of the zero acceleration error type. * 


SECTION 4 — SERVOMECHANISMS 


The control system field is extraordinarily broad and 
most of the previously discussed methods are sufficient 
to describe any linear problems in this field. However, 
this book is concerned with the methods of handling only 
a certain class of control systems. 


From the discussion in the preceding pages it is evident 
that there are two broad classes of control systems: 
open loop control systems and feedback control sys- 
tems. There are aircraft flight control systems in 
both of the classes. Typical examples of an open 
loop system are the common cable or push-pull rod 
surface controls; on the other hand, a hydraulic valve 
cylinder combination or an autopilot are closed loop 
systems. 


Open loop systems are by their very nature calib-ated 
systems, and their performance is profoundly affected 
by the condition of the calibration. Aircraft flight con- 
trol system designers are intimately aware of this and 
expend ua great deal of time attempting to minimize 
environmental effects on the calibration by means of 
such devices as cable tension regulators. In any case, 
the design principles governing those devices are well 


known, Although ono of the end results of 
this volime is to set up criteria govern- 
ing tho performance of these systems, the 
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Figure 41-85. The Fiedd of Control Systems 


bd See Chapter IV. 
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design process itself in these cases will 3. They involve mechanical motion. 


be of no concern,* 


Servomechanisms have the following defining charac- 


teristics: 


1. They are closed loop systems. 
2. A large amount of power is controlled by a 


relatively low power element. in figure II- 83. 
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This is a very broad definition and includes many 
systems not often brought to mind by common parlance, 
Thus such things as autopilots, tracking control sys- 
tems, pilot-airframe combinations, etc., are referred 
to as servomechanisms or servo systems. 


This classification of control systems is illustrated 
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CHAPTER Ill 
ANALYSIS 


SECTION 1 — INTRODUCTION 


System analysis is concerned with an inquiry into 
the behavior of a given system. Previous chapters 
have established that the static and dynamic perform- 
ance of a linear system, including its responses to 
known inputs, is completely determined by its transfer 
function. The problem of linear analysis then becomes 
one of obtaining information about system transfer 
functions. Since servo analysis is primarily con- 
cerned with feedback control systems, the linear analy- 
sis problem is further limited to obtaining information 
regarding closed loop transfer functions from a knowl- 
edge of the open loop transfer functions. This chapter 
will consider the important methods and techniques 
available for solving this limited problem. 


The notion of a feedback control system, such as that 
represented by the block diagram of figure III-1, has 
been previously introduced,and the algebra of such 
block diagrams has been considered. With all of this 
background information understood, the essential 
problem of linear servo analysis can be described. 





Figure III-1. Illustrative Servomechanism 


In the control system represented by figure II-1, 
the closed loop transfer function, which defines the 
properties of the system, is given by: 





Cc 1 
(III-1) a ea 
where Y -K,K,GH, The analysis problem is essentially 
solved when the properties of the closed loop transfer 
functions are known to the analyst. Transfer functions 
are completely specified by their poles, zeros, and scale 
factors. Therefore, the analysis problem to be con- 


(III-2) Y 


(111-3) 


sidered is concerned with gathering information about 
the values of the poles and zeros of the closed loop 
transfer function(1/K,H) (¥/(1+ Y)] from a knowledge of 
the open loop transfer function, y. Since K,H is known, 
the portion of (III-1) requiring additional study 18 the 
bracketed term, Y/(1+Y). 


While the poles and zeros of Y/(1+Y) are the 
prime information required, the major effort of analysis 
need be directed toward finding only the poles, since 
the zeros of Y/(1+Y) are the zeros of Y, and hence 
are known. To illustrate: if N(s) is the numerator of 
Y and D(s) the denominator, 


D(s) 


Y | _N(s)/D(s)_ | __ NGS) 
1¢+Y 1+ N(s)/D(8) N(s) + D(s) 





The analysis problem can now be stated mathematically: 
Given Y, determine the poles of Y/(1+ Y), or 
alternatively the zeros of 1+Y. 


Before the specific content of the chapter is outlined, 
it should be mentioned that a direct analytical method 
of determining the poles and zeros is to factor the 
closed loop transfer function. However, for all but 
the simplest systems, this procedure may be very 
tedious and time consuming. Therefore, direct factori- 
zation is usually impractical and will not be discussed 
in this chapter. However, methods of approximate 
factorization are included in an appendix to this volume 
and may be used if desired. 


The major portion of this chapter consists of three in- 
terrelated sections. These sections are organized so 
that the techniques employed give closed loop zero and 
pole locations with greater and greater accuracy as one 
method succeeds another. 


The first method presented enables one to obtain only 
very general information concerning the regions in 
which the poles and zeros lie. In addition to this in- 
formation, a certain amount of qualitative data can 
sometimes be obtained by analogy between the behavior 
of actual systems and very simple systems by the use 
of transfer function characteristics discussed in the 
fifth section of this chapter. A rule known as the 
Generalized Cauchy-Nyquist Criterion is developed and 
used as the basis of this method. Nyquist diagram 
and s-plane representations of the transfer function 
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are utilized in the application of this criterion. 


The second method peraaits a much more exact deter- 
mination of closed loap pole and zero values. While 
the previous method requires the use of both Nyquist 
diagram and s-plane plots, this section utilizes the 
logarithmic transfer function representation and another 
graphical aid called the Nichols chart. 


The third method is the most exact presented. The 
values of closed loop poles and zeros are determined to 
accuracies limited only by the graphical process in- 
volved. Only the s-plane representation of the transfer 
function is required, from which the loci of closed loop 


poles are obtained. 


The fifth section deals with certain transfer character- 
istics giving valuable response data in special cases. 


It should be noted again that the presentation used in 
this chapter emphasizes the essential unity of presently 
existing methods of servo analysis, and such methods 
are considered directly in terms of transfer function 
graphical representations. This basic unity is stressed 
throughout the chapter, and concepts such as frequency 
response, phase margin and gain margin, which are 
frequently used in the literature, are mentioned only 
incidentally as items of interest in special cases. 


SECTION 2 - THE GENERALIZED NYQUIST METHOD 


The first, and most approximate, method to be dis- 
cussed utilizes polar transfer function plots together 
with the closed loop s-plane plot of transfer function 
poles and zeros. By using the results of a mapping 
theorem it is possible to consider a region of the closed 

loop s-plane and determine the number of poles of the 
closed loop transfer function within that region. 


Before this method can be developed,some fundamental 
concepts must be understood. The first concept is that 
of the "closed loop s-plane." The second involves a 
basic mapping theorem. These ideas will be discussed 
initially, followed by a development and. application 
of the method discussed above to the problem of de- 
termining stability. 


(a) CLOSED LOOP S-PLANE. 


As pointed out in Chapter II the poles and zeros 
of any transfer function may be plotted on an s-plane. 
Such a plot may then be considered a graphical repre- 
sentation of the transfer function. If the poles and 
zeros of a closed loop transfer function are plotted on 
an s-plane, the plane has been particularized to the 
extent that it may now be referred to as a closed loop 
s-plane. Furthermore the plot may be called a graphi- 
cal representation of the closed loop transfer function . 


Since the problem at hand is to determine the closed 
loop transfer function, and thus its poles and zeros, 
obviously the poles and zeros cannot be plotted ex- 
plicitly on the closed loop s-plane. However, it is 
known that the poles and zeros do exist. 


It is the aim of the balance of this section to develop 
a technique by which the poles and zeros of the closed 
loop transfer function may be located approximately on 
the closed loop s-plane. 


(b) THE MAPPING THEOREM. 


As pointed out previaqusly, in order to determine 
the behavior of a closed loop system, it is necessary 
to locate in the s-plane the poles and zeros of the ex- 
pression Y/(1+Y). 


One method, to be described here, of locating these 
zeros and poles requires the use of two graphical con- 
structions. These constructions will be illustrated 
by example. 


Consider the simple third order system of (III-4): 


K 


(111-4) Y* “s(as +1) (bs* 1) 


Y may be plotted for values of s described by the 
contour shown in figure III-2. (The choice of the s 
contour may be considered arbitrary in this example , 





Figure III-2. S-Plane Contour 


but the reasons for choosing particular contours in 
the s-plane will be explained later.) Proceeding from 
A to B, s=+jw, and Y(s) appears as the heavy solid 
part of figure IJI-3. 





. B 
-jw v 


Figure III-3. ¥(s)-Plane Mapping 
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Similarly in the region C to D of figure HI-2, se- jw, and 
Y¥(s) appears as the heavy dotted trace of figure II-3* 

The segment B toC on the s-plane contour is a semi- 
circle of small radius (r-o0) designed to exclude the 
pole at the origin (s= 0). To determine how this plots 
in the Y(s)-plane, substitute s- re/@ in (II-4);then 


GOS cc, cafe ae 
Y¥(re ) re!*(are/¢ + 1) (bred? + 1) 
Hence: 

(III-5) lim Y(re!*) = @ e"J¢ 


r-o 


From (II-6) it may be seen that, as r swings from 
B (p= +n/2) to C (d* -n/2), Y swings from -7/2 to 
en/2 in a positive sense. This is shown by the light 
dotted arc in figure IJI-3. The remainder of the s- 
plane contour (arc DEA ), figure [III-2, represents 
Lim Re’? and mapa into the origin on the Y(s)-plane, 


as shown in Figure III-3. 


R- © 


The mapping theorem** states that: If the contour in 
the s-plane, figure IIJ-2, positively encircles Z geros 
and P poles of1i+ ¥(s), the map of Y(s) encircles the 


point s=-1 N-Z-p times, where Nis the number of 
encirclements and may be either positive or negative. 


A positive encirclement is defined as one in which the 
area enclosed by the contour is always on the left as 
the contour is traversed. 


Since 1+ ¥(s) = 1+ N(S} - PCS) RS) the poles(P)af 1+ ¥(8) 


are simply the poles of Y¥(8) and are known. There- 
fore, the zeros are determined from the equation; 


(111-7) Z=P+N 


On figures II-2 and II-3, the arrows indicate the positive 
sense. The positive sense of encirclements can be 
remembered as the direction in which an observer 
would travel if he walked along the contour so that the 
interior was always to his left. 


To apply these principles to the system of (I-4), first 
note that the contour of figure III-2 includes the entire 
right-half s-plane. Consequently, the examination of 
¥(s) will determine the number of poles (P) in this 
region. To determine how many encirclements of the 
-1 point Y¥(s) makes, draw a vector from the point 
-1 tothe y(s) contour (figure III-4). As the arrow 
head moves along the contour, the vector pivots about 
its tail. Each time the vector sweeps out an angle of 
2n_ in the positive (counter clockwise) direction, a 
positive encirclement is completed. In figure II-4, 
no encirclements occur (N= 0) Consequently , 
Z=P+N=0+0= O. 


Therefore, there are no roots of 1+ ¥(s)in the right half 


* Note that the portion of the curve from CtoD is the 
mirror imuge of that from B to A. 


°* For detailed proof of this theorem see the appendix 
to this volume, Section A IV. 
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Figure III-4. Mapping 


s-plane. Figure III-8b shows this same system plotted 
for a high enough value of the gain K so that there are 
two roots of 1 +Y(s) in the right half of the s-plane. 
This is indicated by the encirclements of s--1 . 


Although this theorem was discussed in terms of a 
specific problem, it is quite general, In the example 
chosen, only the right half s-plane was mapped. But 
any region can be examined for the existence of zeros 
simply by properly designing the mapping contour 
(figure IIT-5). 


Only two assumptiuns are necessary in order to apply 
the mapping theorem: 
1. Y¥(s) isa rational function of s. 
2. None of the poles or zeros lies on the contour 
in the s-plane. 
(It was because of assumption (2) that the contour in 
figure III-2 detoured around the pole at the origin.) 


The following section discusses in detail the use of the 
mapping theorem to determine the stability of closed 
loop systems. 


(c) THE CONVENTIONAL NYQUIST CRITERION 


It was pointed out in Chapter II that if any zeros of 
1+¥(s) have positive real parts, the system described 
by the open loop transfer function Y(s) is unstable. 
Hence, to verify stability alone, the entire right half 
of the s-plane must be explored for zeros of 1 +Y(s) in 
the manner described in Section (b). (Now it is evident 
why a contour of figure III-2 was chosen in Section 
II-2b. 


Since there can be no zeros of 1+ Y(s) in this region 
if the system is to be stable, Z must be zero inN«Z -F, 
and hence the criterion for stability is that N=-P. 
The simple system described by the contour of figure 
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Figure III-5. General Contour Mapping 


IlI-4 is stable. The same system with higher gain, 
figure III-8b,is unstable. 


It is well to review at this point the characteristics 
of the contour used to enclose the right half plane. The 
values of s defining this contour, figure III-2, are given 
as follows: 


(111-8) From A to B s* jw @>w> Ot 
From B to C s= re/? r~0 
p= o when we 0° 
a when w= 0° 
From C to D S* -fw 07 >w>-m 
From D to E s= Re!? R-@ 


For the open loop transfer function Y(s), the presence 
of zeros of 1+ Y(s) in the right half plane is readily 
determined by plotting ¥(s) with the above values sub- 
stituted for s, and then simply counting the encircle- 
ments of -1 and then applying (III-7). 


The actual plotting may be somewhat simplified by the 
following considerations: For physically realizable 
systems, the part of the s-plane contour DEA is un- 
important in determining the plot of ¥(s). This is 
true since ¥(s) = N(s) . A,s*+ rsttAy 

D(s) G,8"+---ea, 
where n, the order of the denominator, must be greater 
than m, the order of the numerator. The value of Y(s) 
corresponding to the contour from DEA is 


lim[Y¥(s))e-pejg * pane es 
aa ) s8=Rejé anR"e n toe rea, 


” ne On ot 


(111-9) 


Consequently, the entire arc DEA maps into the origin 
of the Y¥(s) plane. 


The portion of the ¥(s) contour corresponding to the s- 
plane contour from A to B is just Y(jw) , the simplest 
form of transfer function plot developed in Chapter Il. 
From C to D, Y(s) is given by Y(-ja), which is the 
mirror image about the real axis of Y(+jw). 


Ii-4 


The only part of the contour remaining is that from 
B toc. In many engineering problems, Y has a pole 
of order n at the origin. But one of the conditions upon 
which the mapping theorem can be applied is that the 
s-plane contour does not pass through any poles. Con- 
sequently, the contour is detoured by letting s=- re/¢ 
(with r very small) near the origin. 


Then, since Y(s) is of the form 


N(s 


¥(8) * —Snp(s) 


(111-10) 


substituting s- re/* to avoid the pole of order n 


(111-11) 

An rtes Boe oe etd 
¥(s)+lim ¥(re!*)-lim) oyna hs 
s~o r-o ro [ay rter Sse s+ a, 

Now as the s-plane contour in the region B to C is 
traversed in a positive direction, ¢ goesfrom +7/2 





Figure £11-6. Poles on Imaginary Axis 
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to - 7/2 . Consequently, the contour of Y(s) starts 

at -nn/2 and proceeds to +nn/2 , in a positive sense 

and at a radius equalto ji, _4© .. - Evidently, 
TO Gort 

the portion of Y(s) corresponding to the one from 

B to C of the s-plane contour is an arc of infinite radius. 


There are two comma situations in which this procedure 
must be slightly modified. First, if A,/a, is negative, 
the ¥(s) contour sweeps from ¢nn/2 to -nn/2 ina 
positive sense as s traverses the s-plane contour from 
B toC, figure III-2. Secondly, it sometimes occurs 
that the denominator of Y(s) includes factors of the 
form s?+w?2. To avoid these poles and those at the 
origin,the s-plane contour must take the shape of figure 
III-6 and the map of Y(s) be treated accordingly. 


If Y(s) has no poles at the origin, the device 
of letting s=re/# near s=o is not required, 
and the entire contour of Y(s) is made up of 
¥(+jo), Y(-je), and an are of infinite radius, 
as shown in Figure III-7. The points above are 
illustrated in Figures III-8a to III-8g. 


(4) SPECIFIED MINIMUM DAMPING AND DAMPING { D 
RATIO. -jow 





It is clear that the mapping theorem discussed in Section 
(b) of this chapter could be used in checking any desired 


region of the s-plane for closed loop poles. However, Figure III-7. Simple Contour 
a ee 
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Figuse 111-8 (s'ect 1 of 3 Sheets). Examples of Mapping for Stable and Unstable Systens 
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Figure 111-8 (Sheet 2 of 3 Sheets). Examples of Napping for Stable ant Unstable System 
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Figure 111-8 (Sheet 3 of 3 Sheetn). Examples of Mapping for Stable and Unstable Systems 
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in all cases, the regions checked define the values of 

8 to be substituted in Y¥(s), and hence practical use 
of analysis time usually requires that the boundaries 
of the regions in the s-plane to be examined be defined 
by comparatively simple functions of s. The simplest 
case, that of the conventional Nyquist criterion covered 
in Section III-2c, is of much value in checking stability . 
Two other cases, those of minimum damping and mini- 
mum damping ratio are also of interest and occasional 
importance. These cases will be considered in this 
section. 
































First, consider the minimum damping case. In this 
situation, it is desired to investigate the closed loop 
transfer function for poles having damping less than 
some specified value. The s-plane contour in this 
case is shown in figure DI-9. The values of s defining 
the contour are: 


(111-12) From AtoB 8s-o,-jw 2w2-0 


From B to A s = ReJé R -@ 


where 1/0, = min. damping [and ¢=#-7/2 when we-m 


time constant p= +n/2 when we +o 


For the same reasons mentioned previously, the portion 
of the contour BCA does not contribute to the locus of 






If (-1+¢j0) lies between 
A and B 
P= 3, N=-1, Z"= 2 


If (-1+j0) lies 
between A and C 
P=3, N=0 

Z2=3 


















(a) 





If (-1+j0) lies 
between A and B 
P= 2 
N= 0 
Z= 2 
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Figure III-10 (Sheet 1 of 2 Sheets). Examples of Minimum Damping 
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If (-1+j0) lies 
between A and B 
P= 2, N=#0 
Z= 2 













If (-1+j0) lies 
between A and C 
P= 1, N= 0 
Z= 1 
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If (-1l+jO0) lies 
between A and B 

P= 1, N= 1 ™~ 
Z= 2 ‘ 













If (-i1+j0) lies 
between C and D 
Psl, N=] 

Z*2 













If (-1+j0) lies 
between B and C 
P=1, N= -1, Z=0 













If (-1+j0) lies 
between A and B 
P=1, N20, Z=1 







Figure III-10 (Sheet 2 of 2 Sheets). Examples of Ninimm Damping 
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Figure III-11. Minimum Damping Ratio Contour 


Y¥(s) for physically realizable systems. The value of 
Y(s) corresponding to the remainder of the contour 
in the s-plane is given by: 

(111-13) Y¥(8) = Y¥(-% ¢ Jw) 

Typical examples for this situation are shown in 
figure (III-10). 


Note that for damping greater than the minimum chosen, 
there must be no zeros of 1 + Y(s) in the domain enclosed 
by the contour in the s-plane, i.e., inthe Y(s) plane 
the number of encirclements of the -1 point must be 
such that Z«N+*P=0., 


It is interesting to note in the examples given that under 
no circumstances can the minimum damping time con- 
stant be less thang (see figure III-10e), and that to 
obtain even this damping time the gain must be adjusted 
so that the -1 point lies between points B andC in 
figure ITI-10e. 


For the specified minimum damping ratio case the 
s-plane contour is shown in figure III-11. 


Note that possible poles of 1+ Y¥(S) at s=0 (and else- 
where on the contour) must be avoided in this case as 
in the conventional Nyquist case. The values of s de- 
fined by the contour are given by 


(111-14) From Ato Bs -lwe juoW1-C? @> w>0* 
From B toC s= rejé r~0 

pen-y when w= 0* 

pe-new when weQ* 

From C to D se-lw- joVi-C2 0->w>-@ 
From D to A s=Reié R~ © 


and de -ney when we -@ 
den-wp when ws +@ 


A typical application of the minimum damping ratio 
case is shown in figure III-12. 


SECTION 3—THE OPEN LOOP—CLOSED LOOP LOGARITHMIC METHOD 


(a) GENERAL 


This section discusses a method of estimating closed 
loop poles and zeros from logarithmic open loop trans- 
fer function plots. 


If the transfer functions concerned are ratios of rational 
polynomials, they may be written in factored form, 
all factors in either numerator or denominator being 
first order or quadratic. Each of the magnitudes 
(absolute values) of these factors may be represented 
by a pair of asymptotes on a logarithmic plot, except 
near the intersection of these asymptotes (the ''break- 
point"). Then, Since the use of logarithmic coordinates 
permits addition of the logarithms to replace multipli- 
cation (and division) of the factors, by adding the 
asymptotic factor plots graphically, an "asymptotic" 
graph of the entire transfer function results. All the 
Straight line approximations obtained in this way will 
be referred to in this volume as asymptotes. It is 
realized that this is an extension of the strict mathe- 
matical meaning of the word“asymptote" but this prac- 
tice is well justified by usage in the controls field. 


It will be recalled that the intersection of two asymptotes 
with a Slope difference of 20 db/dec indicates the pre- 
sence of a first order pole ur zero, with the direction 


II1-10 


of the phase curve in that region indicating whether the 
pole or zero is of minimum or non-minimum phase(i.e., 
in the left or right half of the s-plane representation ). 
For quadratic factors (slope differences at intersection 
of 40 db/dec), the asymptote intersection occurs at the 
undamped natural frequency, and the departure of the 
actual plot from the asymptote intersection is equal to 
1/(2 X damping ratio)in decibels. These charac- 
teristics of logarithmic transfer function plots are 
basic to this section. Broadly speaking, the method 
involves the following steps: 
1. The open loop transfer function, Y(s), is 
plotted logarithmically with s set equal to jw. 
2. For a given open loop gain, K, (or open loop 
zero db line), the closed loop transfer function 
plot is constructed. This construction is materially 
aided by the use of approximations and a special 
chart. 
3. The analytical factored form of the closed loop 
transfer function is obtained by establishing the 
asymptotic representation of the plotted curve 
and by utilizing the characteristics of the loparithimic 
plot. This process is aided py the use of previously 
known data (the zeros of the closed loop transter 
dunction) 


The first itera of the above list his been extensively 
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Figure II11-12. Examples of Minimum Damping Ratio 
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If (-1+j0) lies 
between A and B 
P=0, N= 2 
Z=2 


If (-1+j0) lies 
between A and B 
P= 1, Ne=-l 

Z* 0 
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discussed in the transfer function section of Chapter II, 
and needs no further explanation. The second item can 
be achieved by use of approximations and the use of a 
Special chart where required. A subsection will be de- 
voted to the derivation of this chart and approximations 
with examples of their use. The third item (finding the 
analytic form of a given closed loop plot) is essentially 
a curve fitting task. The curve fitting process is made 
practical by the fact that the asymptotes to be fitted to 
the closed loop plot have slopes which are integral 
multiples of + 20 db/dec. Another aid is the fact that the 
zeros of the closed loop are also the zeros of the open 
loop transfer function and hence are known. The pro- 
cess of finding an analytic factored form of a given 
transfer function plot is discussed, with examples, in 
a further subsection. 


(b) RELATIONSHIPS BETWEEN OPEN AND CLOSED 
LOOP TRANSFER FUNCTIONS — CHARTS 


The portion of the closed loop transfer function, Z(s), 
of interest to the discussion of this chapter, is given by 


iN. fa Y(S 
(111-15) Z(s) mi 
A method will now be developed to relate Y(s)/{1+Y(s)] 
to Y¥(s) by simple graphical means. For convenience 
Y¥(jw)/(1+ Y(jw)] will be related to Y(jw). Since this 
is merely a functional representation, jw may later 
be replaced by s. 


Y(jw) is usually readily available in the logarithmic 
graphical form. The logarithmic graphical represen- 
tation of Y(jw)/(1+ ¥(jw)) is obtained from Y(jw) by 
using a special chart which will now be derived. 


If the magnitude (amplitude ratio) and the phase angle 
of the closed loop transfer function are denoted by 
M and ¥, respectively, relationships between Y(jw) and 
constant values of M and y can be derived. If, in 
addition, contours of constant values of M and y are 
superimposed upon a linear, rectangular plot of 
¥(jw) (amplitude ratio of Y(jw) plotted versus the 
phase angle of YCj«j), the phase angle and amplitude 
ratio of Y¥(jw)/(1+ ¥(jw)] can be read directly off the 
plot for a given value of frequency w. In the following 
paragraphs these contours and their associated chart 
will be developed. 


The open loop transfer function, Y(jw), may be re- 
presented as a complex number 


(II1-16) Y¥ (Jew) © x(cw) + Jy(w) 
Then 

. e |Y(jo)_ | . | _x(o)+Jy(w)_ 
CHIT-17) Mla jay” | Tex(ay* dy (eo) 














Ce ED me 


SIENA p 
(1+x(w)] 29 [y(w)} 2 
M?((1+x(w)) 2+ (y(w)) 4) = (x(w)] 2+ [y(w)) ? 
[y(w) ) 2(M2~1) + (x(w) ] 2(M 2-1) + (x(w) ] MM = 0 
By completing the square of the x terms, 


2 m2 M2 
(111-18) (y(w)) 2+ x(w) + A ‘ats 
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(111-18), plotted on a linear rectangular plot, y vs. x, 
is that of a series of circles with centers at 
2 
X, 2£ rare YG = 0 


and with radii 

M 
M? 1 
These ''M circles" are shown in figure III-13. 








Note that to any fixed value of M, there corres- 
ponds an infinite number of combinations of x(w) 
and y(w). If the log of the magnitude of Y (jc), 
i.e., log [x2(w) t+y2(w)]*, in db, is plotted against 
tan*![(y(w)/x(w)] for a series of values of M, these 
"M circles" or lines of constant closed loop transfer 
function amplitude ratio, plot into ''M contours" such 
as those indicated in figure ITI-14. 


Since the amplitude ratio of Y(jw) is ordinarily ex- 
pressed in db, it is most convenient to express the 
amplitude ratio of z(jw) in this form. Consequently on 
all the ensuing plots, M is given in d as in figure II-15. 


Lines of constant closed loop phase angle, ¥, are de- 
rived in a similar fashion. 


ede]. gant VCO) pare _¥(w) 
(IIT -19) 1e¥(jo) Ww tan say tan eT 


By trigonometry, then 


y(w) | yw) 
X(w) *x(w) 


y= tans! J ———__—__—— 


Crea) ypc ¥(w) | 
X (w) 1+x(w) 





which simplifies to 








(111-21) tan y - —-+-- 

x2exey2 

1 ¥_ 4} tan4ye 1] 
r (x4 #84 (y-  - 1| | 
7 2 tan wv. 4] tan? yp 


again the equation of a circle. The radius is 


1 rc Waar 
tan wy [tan ert 


and the center is located at 


(III-22) rs 


~| 


2 x, = -1/2; : —— 
(111-23) 0 Vo 2 tan Ww 


These circles, when plotted on the same logarithmic 
coordinates as the m contours, are the y contours of 
figure I-14. 


The plot of figure I-14, commonly called a Nichols 
chart, enables tne analyst to find easily the closed loop 
values of the transfer function from the open loop, 
either by actual plctting on the chart or simply by 
reference. An example of this method is shown in 
figure III-15, going successively from the open loop 
plot shown in figure III-15a, to the Nichols chart nlot 
of figure III-15b, and then to the closed loop plot of 
figure III-15c. 
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Figure II1-14. Nichols Chart 


In practice, the actual plotting shown in figure IlI-15b 
may be avoided by utilizing the chart as a graphical 
table. 


Accurate versions of Nichols charts are provided in 
figures A-18 and A-19 of the appendix. 


(c) RELATIONSHIP BETWEEN OPEN AND CLOSED 
LOOP TRANSFER FUNCTIONS — BY APPROXIMATION 


Because of certain approximate relationships, much of 
the work required to obtain Y(jw)/(1+Y(jo)) from 

Y¥(jw) by the method shown in the previous subsection 
(II1I-3b) may be reduced. These approximate relation- 

Ships are especially valuable in preliminary studies and 
for any case where rapid, though not extremely accurate, 
results are required. 


It is evident from (III-15) that if ly(sjP>1 then 
(IIT -24) 


or zero decibels. Also If |Y¥(s)K< 1, 


IZ¢s)|*1 
(111-25) Izcs)| = 1¥(s)| 


An exumination of a Nichols chart shows that if 
l¥(jw)|> 25db, the relationship of (III-24) is correct 
within an error of 0.5db. If |¥(jw)|210db, the error 
involved is of the order of 2 db. 


However if |¥(s)| is of the order of magnitude of 1 


III-14 


(0 db), the entire expression for Z(s) must be uSed, 
i.e., where |¥(s)|~1, 


(111-26) Zs) = Y¢s)/[l+ Y(s) 


In those regions of Y¥(s) where (III-24) or (III-25) 
applies,the plot of Z(») is given directly by a knowl- 
edye of y(s). In those regions where (III-26) applies, 
the method outlined in Section III-3b must be used. 


For illustrative purposes several examples of ob- 
taining closed loop plots from open loop plots are 
given below. 


EXAMPLE 1. Assume an open loop transfer function 
3.16/(jw+ 1) which is drawn lightly in figure III-16. 
Where |Y¥(jw)|= |3.16/(jwe1)|210db it will be assumed 
that the closed-loop transfer function |Z(jw)| = Odb. 
Where |Y(jw)|s<-10db it will be assumed that 
|Z(jw)| = |¥(jw)}|. Thus, the dark lines are drawn 
into represent |Z(jw)| in these regions. Where 
10 db >|¥(jw) |* -10 db, the Nichols chart has been used, 
and the results are indicated by dashed lines. It is 
evident that the dashed line does not fair into the solid 
line at the lower end of the frequency range. This 
1S a result of the approximation that was made above 
and could have been predicted. This difficulty may be 
overcome at the outset by a simple calculation of the 
steady state gain. Since 
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Figure III-16. Open Loup to Closed Loop by Approximations 


When N(s) and D(s) are polynomials ending in 1, the 
closed loop steady state gain (s-0) is given by K/(1+ K). 
In general, if N(s) is a polynomial ending in 1, and 
D(s) 148 a polynomial which ends ins, the steady state 
gain is 1. If N(s) is a polynomial ending in s and 
D(s) iS a polynomial ending in 1, the steady state 
gain is zero. If both N(s) and D(s) are polynomials 
ending in S or multiples of s, a limiting process must 
be applied to the steady state gain. 


It may also be noted that the phase curve obtained from 
the Nichols chart is displaced from the curve obtained 
by approximation. The portion obtained from the 
Nichols chart is merely faired into zero and -90° to 
obtain the complete true closed loop phaSe curve. 


EXAMPLE 2. Let Y(s) =.316/{[s(s+1)(10s+1)) . This 
transfer function is drawn in figure III-17. The steady 
state closed loop gain is calculated and found to be 1, 
or zero db. For |Y(jw)|>10db assume |Z(ja)| = Odb. 
For |¥(jw)|<-10 db, assume |Z(jo)|= |Y¥(jo)|. 
This is accomplished by drawing in-‘the dark lines. 
Where 10db2/¥(jw)|2-10db the Nichols chart is used 
(with the results plotted in dashed lines). The complete 
closed loop amplitude curve is obtained by fairing all 
portions of the curve together. 


The complete phase curve is obtained by fairing the low 
frequency end into 0°. The high frequency end of the 
phase curve is very well approximated and requires no 
fairing. 


I-16 


EXAMPLE 3. It is interesting to note what happens 
when the open loop gain of example 2 is raised. Let 
Y(s) = 3.16/s(s¢ 1)(10s¢ LY This is drawn in figure 
Il1-18 and the procedure outlined in the above two ex- 
amples is followed. Note that in this case the closed 
loop phase curve runs from 0° in the direction of +180° 
(this might be stated alternatively from -360° to - 180°) 
in the neighborhood of the first order break point. 


Relationships between amplitude and phase curves of 
the type found in this example will be discussed in the 
next section. It may be pointed out here that the closed 
loop curves of figure III-18 indicate a non-minimum 
phase quadratic in the denominator of the closed loup 
transfer function. In addition this indicates that the 
closed loop system considered is unstable. 


(d) DEVELOPMENT OF ANALYTICAL FORM 
OF CLOSED LOOP TRANSFER FUNCTION FROM 
GRAPHICAL REPRESENTATION 


Once the graphical representation of the closed loop 
transfer function has been obtained, either by the 
method outlined in Section III-3b or the more approxi- 
mate method outlined in §ection MI-3c, the analytical 
form of the transfer function may be obtained ina 
Straightforward fashion. 


As previously shown, the absolute values of the poles 
and zeros of any transfer function are completely de- 
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fined by the breakpoints of an asymptotic plot if all the 
poles and zeros are first order. If a pole or zero is of 
second order, the departure of the actual curve from .he 
breakpoint is also required. The sign of the pole or 
zero, i.e., whether the term is minimum or non- 
minimum phase, is completely determined by the 
direction or slope of the phase curve in the region of 
the pole or zero. Therefore, to determine the analytic 
form of the closed loop function from its plot, it is 
only necessary to establish the asymptotic plot and 
to observe the phase angle change in the immediate 
vicinity of break points. Values of poles and zeros 
are then determined directly from the break point 
frequencies (and break point departures in the case 
of quadratic terms), and signs are determined by the 
local phase angle change. The functional form of 
¥(jw)/{1 +Y(jw)) is then known analytically, and 
Y¥(s)/({1+Y¥(s)} is obtained simply by substituting 
s for jw. 


In determining the asymptotic plot, the following facts 

are of value: | 
1. Any asymptote is a Straight line with a slope 
which is an integral multiple of +20 db/dec. There- 
fore, for any transfer function expressible as the 
ratio of rational, constant coefficient polynomials, 
the change in slope of the asymptotic plot at any 
break point must be an integral multiple of +20 
db/dec. The value of the integral multiplier is, 
of course, the order of the pole or zero. 
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2. In regions where equations (III-24) and (III-25) 
are valid, a portion of the approximate analytic 
factored form of the closed loop is known by a 
simple inspection of the open loop logarithmic 
transfer function plot. 

3. The zeros of the closed loop transfer function 
or its analytic form are known initially, since they 
are also the zeros of the open loop transfer function. 


To illustrate the methods of obtaining the closed loop 
transfer function in analytic, factored form, several 
examples are given below. 


EXAMPLE 1. A closed loop transfer function is shown 
in figure III-19. If the asymptotes to the amplitude 
curve are drawn, it is found that, when extended, they 
meet at a frequency 1/7. Also, at the frequency 
1/7, the phase is -45°. It is evident that the closed 
loop transfer function has the form Z(s)= K/(7,s + 1). 
From the amplitude curve it is seen that the gain in 
dbis K'. The linear gain K may be obtained from 
figure A-20 which relates linear amplitude ratio to. 
decibels. The complete closed loop transfer function 


is then 
Z(8) = K/(7,8 +1) 


EXAMPLE 2. This example is considerably more 
complex than the first. It is introduced to emphasize 
various details. The closed loop transfer function is 
shown in figure I]-20. The asymptotes to the amplitude 
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Figure III-17! Open Loop to Closed Loop by Approximations 
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curve are first drawn. The figure will now be examined 

by starting from the left (or low frequency side) and 

continuing to the right (or high frequency side). 
a. It is evident that at zero frequency the phaSe is 
-180°. This indicates that a negative sign (-) 
Should be placed in front of the closed loop gain K . 
b. The amplitude decreases at -20 db/dec after the 
break at 1/7, . This indicates a first order term 
in the denominator (or pole). However, the phase 
lag is decreasing in the vicinity of 1/7,. This,to- 
gether with the fact that the first order term is in 
the denominator, indicates that the term is non- 
minimum phase of the form 1/(-7,s+¢ 1). 
c. The amplitude breaks from -20 db/dec to 0 db/dec 
at 1/7. This indicates a first order term in the 
numerator. Since the phase lag continues to de- 
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Figure III-19. Obtaining Poles and Zeros of 
Transfer Function 


crease to 0° after this,it indicates a minimum phase 
term of the form (7, s +1). 

d. The amplitude breaks to -20 db/dec after 1/7, 
and the phase decreases at the same time, which 
indicates a first order pole of the form 1/(%s8 +1) . 
e. The amplitude breaks from -20 db/dec to -60 
db/dec atw,. This,together with the peaking at 
w,,, indicates a second order term in the denominator . 
The sharp increase in phase lag atw, indicates 
further that the term is minimum phase. The 
natural frequency is known from the break point, 
and the damping may be determined from the amount 
the peak departs from the asymptotes. (This was 
discussed in an earlier section.) The term then has 
the form 1/((s/w,) 2+ 2(s/w,) + 1). 

f. The amplitude breaks from -60 db/dec to -40 
db/dec at 7, . This indicates a first order term in 
the numerator. Since the phase lag increases in the 
vicinity of 1/7,,this indicates a non-minimum phase 
term of the form (-7,8 +1). All the terms are 
now collected and the closed loop transfer function 
is of the form 

Z(s) * “K(7,8 + 1) (“748 ae 


$e 
(-T_ 8+1) (7. S* nf" —Ss*t | 
Wy) Wy 


with the parameters ¢, (, », obtained from the 
break points. 
In the normal analysis case, the numerator terms 


7) and 7, are known at the outset and aid in establish- 
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ing the asymptotic plot. 


EXAMPLE 3. This final example is an exceptional 
one but is offered to demonstrate that, when the analytic 
form of the closed loop transfer function is obtained 
from the graphical representation, care must be taken 
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Figure III-20. Obtaining Poles and Zeros of 
Transfer Function 


to consider each and all of the following items: 
1. The analytic expression for the open loop transfer 
function. 
2. The graphical representation of the amplitude 
ratio of the closed loop transfer function. 
3. The graphical representation of the phase of 
the closed loop transfer function. 
Consider the closed loop transfer function shown in 
figure III-21. 


If the amplitude ratio curve alone were considered, 
the incorrect conclusion might be reached that the 
transfer function is merely of the form Z(s) =K=1. 
However, the open loop transfer function has the form 
K(-7,5 +1)/(7,8 +1). It is known that the closed 

loop transfer function must have the same zeros as 
the open loop (i.e.,a term in the numerator equal to 
(-7,8+ 1) . The next problem is to determine the 
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Figure III-21. Obtaining Poles an! Zeros of 
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Figure III-22. Graphical Representation of (III-27) and (III-28) 


form of the denominator. Since 


, KN(s 
(5) * “Bcs) 
log|Z(s) | = log|K| + log|N(s) | - log|D(s) | 
(111-27) log| |D(s) ||-1- log|Z(s) | - log|K| - log) N(s) | 
also 


(111-28) -ZD(s) = 224(s) -2K- ZN(8) 


When (III-27) and (111-28) are performed graphically 
as shown in figure III-22, the amplitude and phase 
of 1/D(s) are determined. It is evident that 
1/D(8) = Ur, 8 +1) and thus Z(s) =(-7,8 + 1)K7, 8+1). 
With a little experience the graphical step shown in 
figure III-22 may be eliminated and the complete 


analytical form of 2(s) may be written by inspection 
of its graphical representation. 


SECTION 4 — ROOT LOCUS METHOD 


(a) INTRODUCTION 


Although each of the preceding sections has the purpose 
of locating the zeros and poles of the closed loop trans- 
fer function, the work was performed not on the s-plane 
(in which the poles and zeros are located) but on the 
Y(s) -plane. Of course, this was done as a matter of 
convenience in obtaining quick approximations to the 
solution of the problem. The cost of this procedure 
is that the values of the poles and zeros must be more 
or less extracted from the graphical representations 
used. 


The root locus method deals with the s-plane exclusively 
and yields a plot of the locus of all possible roots of 
D(s) «+ KN(s) -0 (where D(S) ¢ KN(s) is the denominator 
of the closed loop transfer function) as a function of 
gain, Thus, a mere glance suffices to diScuver a 


IIi-20 


nearly complete picture of the dynamics of the system. 
(b) BASIC PRINCIPLES 


The fundamental problem in establishing a locus of 
roots of D(s) «+ KN(s) =0 is the same as existed in the 
preceding methods; that is, How can these roots be 
found by working with Y(s) only To determine the 
root locus method answer to this question, first note 
that 


(111-29) 


1+ Y(s)2 1 2 


D(s) + KN(S) _ 
D(s) 


Hence, if D(s) is finite, roots of D(s) «K N(s)-Oare 
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zeros of 1 + ¥(s). When D(s)«®,a special case occurs. 
In physical problems the order of D(s) is always greater 
than that of N(s), so that for finite K, 


D(s) + KN(s) . D(s) 
us B(s) 1) : 


which is not equivalent to (HI-29). However, if K is 
infinitely large, 


Lie D(s)*+ KN(8) , @ 

s-@ D(8) ad 
and the limiting process might possibly reveal roots. * 
Consequently, except under this condition, the solution 
D(s)=@ is trivial; in all other cases the equation 
D(s) +KN(8) = 0 will reveal all of the zeros of 1 « ¥(8) of 
interest (i.e., zeros corresponding to finite values of 
K). This is the first principle upon which the root 
locus method is based. 


The second important fact upon which the method de- 
pends is that the denominator of the closed loop trans- 
fer function of a single loop feedback system is of the 
form 1+¢Y¥(8). Because of this, instead of solving the 
equation 1+Y(s) -0 , it is possible to work with the 
equivalent expression Y¥(s)*#-). Now, Y(s) can be 
written as a complex number R(s)e/**) for any value 
of s. Also, -1 is a complex number, -1- 1¢/(2* +) *, 
Consequently, if Y¥(s) = -1 then it must be true that 

(111-30) Rela gi (aktl)s 

where keO, 21, 22,2... sothat Re land $= (2+ 1)7; 
that is, the magnitude of the complex number, Y(s), 
must be unity, and its phase angle an odd multiple of 
w if S itself can be a root of 1+Y¥(s) «0. 


Y(s) is usually of the form 


¥(s) ° 2K N(s) 


(111-31) es 


N(s) and D(s) are usually written in the form 


2 2 
s"(7,821) (79821)... Es ze svi|f Sr = sn ai 


For purposes of working with root loci, it is con- 
venient to rewrite this as 


(111-32) —-!"2°"* sa/g, 1D) és, J 
ae ey ee ary se 


eee(S? # 20, | St w, 2} (s?« 20 8+ w,7).. 


: a (oer |e d), 7 


-2+((see +Jw,) (sto ,-jo,)) [(seo7g¢ joe) (St g-Jw)]... 


where %, * “ny and a, = a, V1 - Cf. When N(s) and 
b(s) are written in this form, Y(s) can be expressed 
as 


Y(s) = 2K « N‘ (3) 
D‘ (s) 
* This situation is discussed in greater detail later 
on. 


(111-33) 
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where N’ (8) and D’ (s) are the factors containing as, and 
the quantity « is the ratio r/1,.../a? af ..., Now each 
of the factors of N’(s) and D'(s) is ¢ complex number 
(for any value of 8) and hence can be plotted as a vec- 
tor, as in the left hand column of figure I-23. 


Since 

(111-34) 

+KiN' (s) 2K Ty Ty ee Ty Ty) gi PNet OMe t+ PONe) 
e | 2d 

D' (8) Foo... Fo, Fo, | 92D. OD 9+ ODe) 


where the r, are the magnitudes and the %,, 
phase angles, ‘of the vectors representing the Pps 
of .W’ (8), and the rp, and the 0,» the corresponding 
quantities for D’(s). 


The quantity in the brackets in (I-34) can be written as 


BK aD Ty wee By Py Kx Al ly 
as nr 11: maenee § 
a 
a PRE r r 
td Cid PS We fl *o, 
j*o 


It is also convenient to denote the total phase angle 
of  ’(s)/D’ (8) by 


(IITT-38) 
o* Hy terete + - ? - 


° i 


Then, by expressing each of the factors of N’ (s) and 
D’(s) as vectors, the conditions that s be a root of 
1+¥(s8)=0 can be written as 


(111-36) 


a 
K x J Ty, = 
a 


Ir 
suo 9 


«© (2k ¢1)n k#0, #1, £2, #.... 
J 


(when the + sign appears before K ) 


or 
3 : k 
iso on, j=0 "2 7 Oe aye ea Pye 


(when the- sign appears before K ) 


However, for reasons that will become apparent later, 
it is more convenient to shift the vectors as in the 
right hand column of figure HI-23. Consequently, 
roots of 1 + ¥(s) can be determined by choosing a trial 
point on the s-plane and drawing vectors to this point 
from each of the poles and zeros of Y¥(s).* If the 
products of the lengths of the vectors ry and of Kx 
divided by the product of the lengths of the vectors 
rp°1, (see equation ITI-34) and the sum of the angles 
e(2k ¢1)wz, then the trial point represents a root of the 
equation D(s} + KN(s) = 0 ( * sign before K). Angles 
measured from a reference line through 8 are positive 


* Note that by shifting the vectors as show in the 
right hand column of Pig. (III-23), the points 1/7, 


and ozjw become the poles or zeros of Y¥(s). This 
is one advantage of the shift. 
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Figure JII-23. Phase Angle of Vectors (s +1/7)(8-1/7)). (800 + jw), and (8+0- jw) 


when measured as shown in figure III-24. It is to be noted that since 7/A(2ke1)7, in this example, 
the point cannot possibly be a root. Another trial point 
must be chosen and the angles added to test its possi- 
bilities of being a root. With experience, only very few 


J 
: TK trials are needed to locate a point that meets the test: 
Y¥( SS) we es, 
s(s+—*) (.+4 (111-37) 
Th 72 


mes 


a 
i=0 Ay” 1X0 %, = (el) a k= 0, #1, $2, 25-00 


for+ K 


or «= &n for- K 


The root locus method consists of determining a num- 
ber of such points in this fashion and drawing a curve 
“igure I11-24. Typical Construction through these points, the locus of possible roots; and 


ee Cd LI Ld Cd Lo od to oD 


Care Ee ae. 5; ! “ernie 


iJetl oda 


iN ill 


vt 


Jou 


u | 


for all points along the locus, 

a 

1 ry 
(111-38) Kx 2-1. 1 

Tp 

jeo "J 
must be satisfied. The process is considerably speeded 
by the use of a graphical aid (the "Root Locus Plotter") 
to be described later. 


(c) CONSTRUCTING THE LOCUS 


As with any graphical construction, root locus plotting 
is speeded up by establishing: 

1. Starting points 

2. End points 

3. Special intermediate points 

4. Asymptotes 
In constructing a locus of roots,these points and the 
asymptotes can be established by inspection. 


The starting points of the root locus plot are defined as 
those points that represent roots of D(s)+ KN(8)» 0 when 
K approaches zero. Since the order of D(s) is always 
greater than that of N(s) , 


(TIT -39) Lim D(s) ¢ KN(s) = D(s) - 


for any value of s at all. Then the equation D(s)+KN(s)=0 
becomes, in this case, D (s)=0. Hence the locus of 
possible roots of D (s) + KN(s) = O starts (at gain K - 
0 )* at the zeros of D(s), i.e., the poles of ¥(s). As 
K is increased from zero, the locus must move away 
from the poles of Y(s) in some direction not yet de- 
termined (see figure III-25). 


{ Kr 1 
ja | a. f i =] 
s -Plane ¥(8) = “f Ive 2) 
8 ‘ + A f ¢ 7, 
\I7 \IZ \I4 
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X% indicates zero 


Figure III-25. Starting Points of Locus 


The end points are defined as those points that represent 
roots of D(s) + KN(s) «0 when K approaches infinity . 
However, it was shown at the beginning of Section (b) 
that there was a possibility of having roots which them- 


* When the gain(k,) ofaclosed loop system is zero, an 
input cannot cause an output ~* 
Consequently, the concept of amirils ° 
‘roots at zero gain’ may be confusing. What actually 
happens is that as the gain gets very small, the 
roots approach certain finite values while the am- 
plitudes of the transient terms approach zero. Thus, 
the type of response is defined by the finite roots 
of the denominator of Y(s), but the response itself 
becomes imperceptibly small in magnitude. 
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selves are very large (s~%) when K is large (K~™ . 
Consequently, there are two conditions which must be 
investigated to locate the end points: 


1. Lim (D(s) + KN(s)], (8 finite) 


2. Lia ([D(s) + KN(s)), (K large) 
In the first condition 


(III-40) Lim D(s) + KN(s) = Lim KN(s), (8 finite) 


and, in this event, D(s) + KN(s) = 0 reduces to KN(s) =0. 
Consequently, ‘at high gain (K) the locus must enter each 
of the zeros of N(s), figure III-26, which are also the 
zeros of Y(s). 
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Figure III-26. Starting and End Points of Locus 


But since the order of N(s) is always less than that of 
D(s) , and since the order of D(s) ¢ KN(s) is equal to 
the order of D(s) , there are(n-m)*roots still to be 
accounted for at high gain. Since condition (1) did not 
reveal them, these remaining roots must correspond 
to condition (2)g that is, the roots occur at s~-@. 
This is illustrated in figure I-27. An observer lo- 
cated far away from the origin of the s-plane and from 
all the zeros and poles sees the zeros and poles of 
Y (s) all bunched up on the s-plane near the origin. 


In fact, from far enough out in the plane, the vector 
angles of all the factors become very nearly equal. 
Then the angle of a vector from a zero to the trial 
point far out on the plane appears to cancel the angle 
of a vector from one of the poles to the trial point. 
The result is that each zero appears to cancel a pole 
so that the plot of Y(s) looks like simply a multiple 
order pole at the origin. The order of the pole will 
be the difference between the number of poles and 
zeros of Y¥(s); thatis 





ae KN(s) _ _K 
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Consequently, for large values of s, there appear to 
be no zeros of Y(s), and D(s)=s""*. So 


(III -42) Lim D(s) + KN(s)*s®°"® 
8-@ 


* mn and m are the orders of D(s) and N(8s) respec- 
tively. See equation (III-36). 
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Figure III-27, Limiting Values of Angles as|s|-© 


a 
Now, since 2%, = 0 and fy op, +++" Ot ++) Poe 


a a-a 
on” py %, - —. Poa "A(N-B) Py, * (2k¢1)7 or 2kn 


120 j#0 


k=0, #1, 22, #3, #... 


then 
. (2k + 1)7 2k . 
(111-43) Poa ol ene k 0,+1,2#2, 23,2... 


Evidently vectors drawn pointing away from the origin 
at angles ¢), will point to large roots of D(s)+ KN(s) = 0 
for large values of K. 


At this point it is well to recall that it has been deter- 
mined that at zero gain the roots of D(s)+ KN(s) = 0 are 
Simply the roots of D(s) = 0 and that as gain (K) in- 
creases, the locus must proceed away from these roots. 
It has also been determined that under some conditions 
the roots of D(s)+ KN(s)»0 for large values of K are the 
roots of KN(s) - 0 and for other cases they appear far 
out in the s-plane at angles ¢),. Since the locus has 
several starting points, and several terminating points, 
it would appear that the locus is not a single continuous 
curve, but rather consists of several branches. Certain 
branches will start at the poles of yY(s) (roots of 
D (s) = 0 ) and proceed to zeros of Y(s) (roots of 
KN(s) = 0) and other branches will start at other poles 
and proceed toward the roots at infinity in the direction 
of the angles ¢%,. Thus it would appear that (III-43) 
establishes asymptotes for n-wm branches of the locus. 
It will be shown in the following pages that this is true 
(see figure DI-28). 


Starting points, end points, and asymptotes have been 
established. Some intermediate points can be es- 
tablished by closer examination of certain parts of 
the s-plane. Consider first the real axis. To determine 
whether or not there are any possible roots there, take 
a trial point (s) on the real axis, figure III-29. 


All the vectors from the zeros and poles to point s, 
make angles nearly zero. Consequently <4 0 and 
there cannot possibly be any roots along the positive 
real axis. Next try a point s, near the real axis be- 
tween - 1/7, and the origin (figure III-30). In this 
case the vector from the pole at the origin has an 
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Figure III-28. Starting Points, End Points 
and Asympt otes 


angle of approximately 180°, and the rest of the poles 
and zeros contribute nothing. Consequently, there 
can be roots anywhere between the pole - 1/r, and 
the pole at the origin. It should be noted that the 
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question of whether or not the poles themselves lie 
on the locus cannot be answered since the angle of 
a vector from the pole to a test point lying on the pole 
is undetermined. 
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Figure III-30. Test for Roots betwoen -1/7T, + j0 
and Origin 


A repetition of this process will show that there are 
also possible roots between the pole at - 1/7, and the 
zero at -1/7,. Consequently, a part of the locus is 
established along the real axis (see figure III-31). 


At this point it is known that the part of the real axis 
between the pole at - 1/7, and the zero at - 1/7, must 
contain part of the locus. It is also known that the 
lucus proceeds away from this pole and toward the 
zero. It remains to be shown that the only path the 
locus can take between these two points is along the 
real axis. This is proved by noting that if the locus 
proceeds away from the pole and departs from the 
real axiS, say, above it, another part of the locus 
must appear below the axis, symmetrical with the 
part above it. This is so because each complex root 
on the locus must have a conjugate. Then, at very 
low values of K,two roots would appear approximately 
at the pole- 1/7,. But when (III-39) is applied to this 
example it can be seen that only one root (i.e. ,8 =-1/12) 
can appear at this point. Therefore, the locus must 
proceed away from the pole along the real axis. A 
Similar argument applying equation (III-40) shows 
that the locus must approach the zero - 1/7, along 
the real axis also. This is shown in figure III-31. 
(Of course, when this same argument is applied to 
a system involving higher order zeros and poles on 
the real axis, it will be found that it is possible for 
the locus to appear in the complex part of the plane 
in the immediate vicinity of the zeros and poles. ) 


To complete the locus, it is necessary to find how the 
roots approach infinity along the asymptotes. To do 
this another characteristic of the expression D(s)+ KN (s) 
must be understood. 
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Figure III-31. Locus Along the Real Axis 


N(8) and D(s) are of the form 
N(3), Ags®+ A,_,8®"'+... +A, 8! 
D(s) = B,s"+ B,_,8°"'+,,. «Bys! 


Consequently, 
(111-44) 


D(s) + KN(8) = B,s"+ B,_,8°"!+... +(B, + KA.) 8" 
¢ (BL, * KA_,)s®°!¢...*(B, + KA,)8! 


It is known from algebra* that each root of an equation 
is a continuous function of the coefficients of the equa- 
tion. In (III-44) the coefficients A; and B, are constant, 
but K is varied continuously in constructing the locus of 
roots. Consequently, the coefficients (B, «KA,) are 
continuous functions of K and therefore, the roots of 
(III-44) must be continuous. Therefore, each branch 
of the locus of roots must be continuous. This means 
that the locus must break away from the real axis and 
approach the asymptotes at infinity. The part of the 
locus away from the real axis represents complex 
conjugate roots. The only places where such roots 
could have started are the poles at - 1/7, and at the 
origin. 


Consequently, at some particular gain (K), the locus 
breaks away from the real axis in opposite directions 
as shown in figure ITI-32. 





Figure III-32. Breakaway Point 


The remainder of the locus must be established by 
a trial and error procedure as described above. It 
is repeated in figure III-33 in order to show how the 
vector originating at the zero is handled. 


Repetition of this procedure yields the locus shown in 
figure ITI-34. 


° See BOcher, ‘Introduction to Higher Algebra’ (Ref- 
erence 8). 
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Figure III-33. Trial Angle Calculations 
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Locus of Roots 
of {1+¥(s)] =0 ee, 





Figure III-34, Complete Locus 


In order to locate the roots corresponding to a known 
value of gain (K), points on each of the branches of the 
locus are chosen and the lengths of the vectors meas- 
ured. If these lengths satisfy (I-36), the points repre- 
sent roots for this value of K. However, in the more 
common problem, K is unknown and is to be determined 
in order to place the roots at certain desired locations 
as discussed in Section II-3e. In this problem, the de- 
Sired root on the locus is chosen and the gain (kK) com- 
puted as the unknown in equation (III-36). 
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Figure I1I-35. Calculation of kK for u Chosen Root s, 


When Y(s) contains complex roots, the procedure is 
identical to that previously described. However, since 


I-26 


the graphical construction has a slightly different ap- 
pearance the following discussion is included to avoid 
possible confusion. The example also includes a pole 
on the positive real axis. 
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Figure III-36. Location of Locus on Real Axis 


In figure III-36 a point near the positive real axis 
beyond + 1/7, is chosen to check for roots there. The 
angles of the vectors from the poles and zeros on the 
real axis are all zero. The angles to vectors origi- 
nating at the complex poles are non-zero but they are 
equal and opposite so the net angle is zero; therefore 
there are no roots beyond the 1/rT,. Repeating this 
procedure along the real axis locates roots between 
the origin and the pole at 1/7, and between - 1/7, and 
-©. Consequently, the locus along the real axis ap- 
pears as in figure III-37. This illustration also shows 
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the asymptotes and how the vectors are drawn from 
the complex poles. (The points at which the locus 
enters and leaves the real axis are still undetermined 
but are shown to indicate what the locus must do. ) 
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In order to determine in which direction the locus 
moves away from the complex poles, a trial point is 
taken very close to one of them. The point is taken 
so close to the pole that the vectors drawn from all 
the other poles and zeros to the trial point look as 
though they terminated right on the complex pole being 
investigated. This is shown in figure III-38. Al- 
though this trial point is taken very near the complex 
pole,its exact location above, below, left,or right of 


d, - (0 +d, + 4, ) 
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° -480 + 360 = -120° Zp- 180° = dy = -120 
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Figure III-38. Establishing Direction of Departure 
from Complex Pole 
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the pole is left undetermined. Consequently, when 
the angles are added, the angle to the vector from 
the complex pole being investigated to the trial point 
is left out (in this example ¢,); and in order that the 
trial point lie on the locus, the sum of the angles in 
this example must be ¢)-(¢2 * ¢4 # $, * $3)" 180K; gaa) or 
$y = $1- (hy + dy + by + 180K aay). In the figure it is seen 
that ¢,=-120°. This means that the vector from the 
complex pole to the trial point lies down and to the 
left as shown by the inset in figure III-38. With this 
added information, figure III-39 can be constructed. 


Figure III-40 indicates some possible forms of the 
locus. Several intermediate points must be deter- 
mined in order to show which is the correct locus. 


(4d) THE ROOT LOCUS PLOTTER 


Constructing a locus of roots using the techniques 
described would be a tedious job and the method would 
not be very valuable to the designer. However, it is 
possible to devise a simple tool that greatly simplifies 
and expedites the work. The use of this tool will now 
be discussed. 


One form of the plotter is shown in figures III-41 and 
Ill-42. 


The technique of using the plotter is indicated in figures 
I1I-43 through MI-52. The pintle is first placed on the 
trial point. In this position, the card and disc are held 
together by the action of the spring. The disc and pintle 
are then depressed by pressing on the top of the pintle. 
This releases the card from the disc. The card is now 
free to rotate without carrying the disc with it, the 
latter being held in its initial position by the pressure 
On it. 


For the purpose of showing clearly what is happening, 
the plotter will now be reduced to Schematic form, 
figure III-44. 


The system shown in figure IJI-24 will be used for 
illustration. To determine if a point s, lies on the 
locus of roots for this system, place the pintle of 
the plotter s, as shown in figure III-45. 


The disc is depressed and the reference line on the 
card moved until it coincides with the line from s, to 
- 1/72 as shown in figure ITI-46. 





Figure III-40. Root Locus Forms 
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Figure I11-41. Diagrammatic Representation of Root 
Locus Plotter 





Figure 111-43. Cross Section of Root Locus Plotter 
Showing Card Freed From Disc 
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Figure II1-45, Use of Root Locus Plotter 
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Figure III-42. Cross Section of Root Locus Plotter 
Showing Disc Locked to Card 
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Figure III-44, Schematic of Root Locus Plotter 
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Figure III-46, Use of Root Locus Plotter 





The pointer is now released and the entire plotter is 
swung back until the reference line again coincides 
with the reference direction, i.e., the horizontal 
direction through 8,. This operation will have rotated 
the disc through an angle g,, with respect to the card. 
The plotter now appears as shown in figure III-47. 
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Figure 111-47. Use of Reot Locua Plotter 
IlI- 28 


This process is now repeated using -1/7,, as shown 
in figures I-48 and III-49. 
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Figure []]-48. Use of Root Locus Plotter 


The plotter is again reoriented upon the reference 
line as shown in figure III-49 and now has ¢, ¢ ¢, added 
into it as shown by the relative position of disc to card. 
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Figure I[II-49. Use of Root Locus Plotter 


The process is repeated for the root at the origin as 
shown in figures III-60 and I-61. 
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Figure III-50. Use of Root Locus Plotter 


When the plotter is returned to its initial position, 
as shown in figure II-61, it is seen that the sum of 
the angles thus measured is not equal to 180°. This 
is indicated by the fact that the pointer has not exactly 
reversed its direction, 
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Figure III-51. Use of Root Locus Plotter 
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Since,for this particular s,,¢>180°, a second trial 
point, 82, lying on the same horizontal line is selected, 
and the entire process repeated for it. A possible 
result is shown in figure I-62. 


For 82, @< 180°. Since the two points, s,ands,, lie 
on the same horizontal line, the locus must pass be- 
tween them. 
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Figure III-52. Use of Root: Locus Plotter 


When zeros occur in the transfer function,it is neces- 
sary to subtract their angles from those of the poles. 
This is done by reversing the order of operations in 
using the plotter, as is illustrated in the following 
example, using the transfer function of (III-43). 


rap 


(111-43) Y(8) * Kx ares 
8(s¢ me 


The poles and zeros of (III-43) are plotted In figure 
17-63. 


Figure III-53. Poles and Zeros of Equation (III-43) 


Select a point s,, and add into the plotter the angle 
to the pole -1/r,, ¢,, a8 shown in figure II-54. 


The plotter is returned to its original position as shown 
in figure IIT-56. 


The next critical point to be considered is -1/r, . 
Since it is a zero, its angle must be subtracted from 
the sum of the angles of the poles. This is done as 
follows: Without depressing the pointer, the card is 
oriented with the reference line lying along the vector 
joining s, and -1/r, as shown in figure IIJ-66. 


The pointer is then depressed and the reference line 
swung through the clockwise angle ¢, to the reference 
direction as shown in figure III-57. 


IiI- 39 


Chapter III 
Section 4 





Figure [II-54. Use of Plotter for Open Loop Transfer 
Function with Zeros and Poles 
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Figure IJJI-56. Use of Plotter for Open Loop Transfer 
Function with Zeros and Poles 
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Figure JII-55. Use of Plotter for Open Loop Transfer 
Function with Zeros and Poles 
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Figure III-57. Use of Plotter for Open Loop Transfer 
Function with Zeros and Poles 





The angle ¢, that was in the plotter prior to this last 
step has been reduced by 4¢,. 


In this way, by rotating the plotter before or after 
releasing the disc, it is possible to take care of both 
zeros and poles. 


A logarithmic spiral marked on the plotter can be 
used to multiply the lengths of the vectors according 
to equation (III-36), The equation of a logarithmic 
Spiral is of the form 


(111-46) re a’/% 
(see figure I1I-58) or 


(111-47) log,gt+ (108,98) & 
(*] 


In these relations, the quantities a and 6, are para- 
meters which can be used to set the linear and angular 
scales. 


Consider, as an example, the vectors r, andr,, such 
that the corresponding angles on the logarithmic spiral 


¥ 


are 6, and 6,. Then if r-r,r, (see figure III-59), 


(IIT-45) log, re 10g, 9%, + log, ra * fe (6, + 0g) 
| 


Figure IJII-58. Logarithmic Spiral 
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It is convenient to take a+=10 and6, 7/2. When this 
is done, the radius vector of the curve is increased 
by a factor 10 if the angle 6 is increased by 90°. 


Figure III-60 shows the general appearance of the 
part of the logarithmic spiral lying in the second, 
third,and fourth quadrants. (It is to be noted here 
that the angle 6 is measured from the upward vertical 
direction, and not from the horizontal.) 
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Figure [I[-60. Multiplication Factors 


Figure I-60 shows that if the vector being measured 
is in the second quadrant, its numerical value lies 
between 1 and 10; in the third, between 10 and 100; in 
the fourth, between 100 and 1000, etc. Thus, if the 
radius vector representing a product of the lengths 
falls in the second quadrant, that is, if its end lies 
on the portion of the curve actually inscribed on the 
plotter, the product is read off directly. 


It is a property of this logarithmic spiral that if a 
radius vector, r,, leads another radius vector, r,, 
by 90°, then r, = 10r,; for a lead angle of 180°r, =100r,; 
and, in general, if r, leads r, by nx90°, r,+10"r;. 
This makes it possible to find the magnitude of any 
vector by using only the part of the spiral lying in 
the second quadrant; if r, falls in the third quadrant, 
read off the value of the radius vector in the second 
quadrant which lags r, by 90° and multiply this value 
by 10; if r, falls in the fourth quadrant, read the value 


of r in the second quadrant which lags behind r, by 
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Figure III-61. Determination of K for a Point on the 
Root Locus of ¥(8)* (Kx)/[s(s+#)(s+4,)] 
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2x 90° (this is simply the radius vector lying along 
the extension of r, backwards, into the second quadrant) 
and multiply its value by 100, and soon. r is always 
evaluated in the second quadrant, and the result multi- 
plied by a power of ten whose exponent is the smallest 
number of clockwise right angles needed to bring the 
actual radius vector into the second quadrant. 


For example, assume that the gain is desired at the 
point s, on the locus of figure III-61. The plotter is 
to be aligned initially as shown in figure IJ-61 with 
Ky log reference line along the line joining s, and 
“l/r le 


The disc is depressed and the card rotated until the 
log curve falls upon the point -1/7T, as shown in figure 
III-62. 





Figure III-62. Determination of K for a Point on the 
Root Locus of Y¥(8) = (Kx)/(s(8 +4 )(8 ¢)) 





Figure III-63. Determination of K for a point on the 
Root Locus of Y(8) = (Kx)/[0(8 +d) (8+ Fy)) 


Since the head of the arrow lies in the second quadrant, 
[s,+ 1/7, | is measured directly on the logarithmic 
spiral. 


To multiply |s, + 1/73] by |s, «1/7,| the entire plotter 
is then allgned, with the "log reference line" lying 
along the vector from s, to the root -1/7, as shown 
in figure III-63. 
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Again the disc is depressed and the card is swung 
until the log curve falls upon the root -1/7, as shown 
in figure III-64. 






Point of Interest 


Figure III-64. Determination of K for a Point 
on the Root Locus 


For the roots chosen for this example, the arrow 
on the disc now lies in the third quadrant; so the pro- 
duct r,r, is read from the plotter as shown and the 
answer multiplied by 10. 


If there are zeros ina Y (8) being investigated, it is 
still possible to determine the gain in one continuous 
process; the zeros and poles may be taken into account 
in any convenient order. It is only necessary to sub- 
tract the angle on the spirule corresponding to a zero. 
This may be done in the same way as the angles due 
to zeros were subtracted in determining the root locus 
itself. 


(e) APPLICATIONS 


The root locus method yields a plot of the poles of 
the closed loop transfer function (Y¥(s)]/{1+*Y¥(s)] as 
K varies from 0 to@. Consequently, if the locus 
moves into the right half plane, the possibility of in- 
Stability exists. In design problems, the locus is 
usually plotted for a proposed system and the gain 
is adjusted so that a certain damping ratio ({) or 
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Figure III-65. Root Locus of Simple System 


damping factor ({«,) is obtained. If desired stability 
cannot be achieved for any gain, equalization becomes 
necessary (i.e., adding poles and zeros to alter the 
loci). 


Whenever a zero is added to Y(s), it has the effect of 
drawing the locus toward it. Conversely, whenever a 
zero is removed, the locus moves away from the va- 
cated point. For example, the system of figure II-34 
can never become unstable because of the zero at 
-1/r,. If the zero is removed, the locus appears as 
in figure I-65. At high values of gain this system 
becomes unstable because of the roots s ,=(w,+a, 41 - (4 

and 8; © {a -«,%1- (7 inthe right half plane. This 
cannot happen as long as the zero is present in the 
left half plane. This is illustrated by figure III-66 
in which the zero is located at two different positions. 
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Figure III-66. Effect of Zoro on Negative Real Axis 


When a complex conjugate pair of zeros is added to 
the system of figure III-65, the locus appears as in' 
figure III-67, while the zero on the positive real axis 
draws the locus to itself producing a system that is 
unstable for any value of gain (see figure IIJ- 68). 
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Figure I1I-67. Effect of a Pair of 
Complex Conjugate Zeros 


Poles repel the locus; this is shown by a resketch of 
figure III-65 in which the pole at -1/r, is moved along 
the real axis from the origin to -~(see figure III-69). 


Figure I-70 illustrates a common occurrence in the 
analysis of complex systems. As the zero is moved 
along the real axis,a Situation is reached in which the 
branches of the locus have a pair of complex conjugate 
roots in common, It is not possible to determine this 
point directly by the methods just discussed, but it 
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may be obtained by extrapolating the parts of the locus 
in the immediate vicinity. 





Figure III-68. Effect of Zero on Positive Real Axis 


However, if for some reason it is important to know 
the value of the equal roots (common point in figure 
IlI-70(c)), the method described in Reference 5 (page 
159) can be warked out on the root locus plot. However, 
this is very rarely of interest. 


Section II-3(e) discusses a graphical method of obtaining 
the coefficients of an equation of motion in the time do- 
main from a plot of the poles and zeros of the equation 
in the s plane. Now, in the closed loop transfer funct- 
ion, Z(8) = [Y¥(s)]/(1 + ¥(s)]»([KN(s)]/(D(s8) «KN(8)], the 
zeros are the roots of KN(s) = 0 and are known, and 
the poles are the roots of D(S)+*KN(s) » 0 which can be 
obtained on the s-plane by the root locus method. 
Consequently, the graphical procedure of Section 1-3 
(e). can be carried out right on the root locus plot to 
obtain the coefficients of the closed loop equation of 
motion in the time domain. 


A final note of caution should be sounded here concern- 
ing the form of ¥(s) to be used in the root locus method. 
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Figure III-69. Effect of Pole Location on 
Shape of Locus 


It is important that in the expression for Y¥(s), 


(ot p)(s1L)(s% 2,0, 8+ «,2) 


(6) 2h ie Cy ee YS Se eae 

(ss 7,)(8 : 7) (8 : 26 4%, 8° wg) 

all of the s that stand alone (the s of s21/7,, the 
g? 22,8 +o.) be preceded by a + sign and that 
K be a positive number. Unless this is done con- 

sistently, the analyst will frequently use the criterion 
Spe (2k ¢ 1)7 when he should be using 3+ 2kv7, and 

worthless results will be obtained. 





Figure III-70. Effect of Zero Location on Shape of Locus 


SECTION 5— SPECIAL CASES: GAIN MARGIN, PHASE MARGIN, MAXIMUM 
MAGNIFICATION RATIO 


While the previous portions of this chapter have covered 
the most important analytical tools used in servo- 


mechanisms work, completeness requires the con- 
sideration of certain other concepts that are often 
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useful. These concepts are all concerned with ob- 
taining approximate data regarding the closed loop 
transfer function and hence the transient response. 
The approach used in this section w’; 1] be to define 
pertinent quantities initially and then to discuss what 
information may be obtained from a knowledge of these 
quantities. 


An open loop transfer function polar plot is shown in 
figure I-71. 
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Figure IJJ-71. Mp. and Gain and Phase Margins 


The first of the quantities to be considered is the maxi- 
mum value of the closed loop transfer function, which 
is defined by the M circle just tangent to the open loop 
locus. This value of M is called the peak magnification 
ratio of the closed loop system, and is denoted by 
M, . The second quantity is the phase margin; it is 
the angle between the negative real axis and the Y(jw) 
vector for the frequency at which |Y(jw)| is unity. The 
third quantity is the gain margin, and is the value of 
|1- ¥(ja)| for the frequency at which Y(jw) has a phase 
angle of -180°. (The same quantities could of course 
have been defined in the same way utilizing an open 

loop logarithmic plot. The polar plot was used only 
for convenience.) It should be noted that each of the 
quantities approximately defines the closeness of the 
open loop plot to the minus one point. Since the close- 





ness of the open loop transfer function to this point is 
a measure of relative stability of the modes existing 
in this region, the M, value, phase margin, and gain 
margin have been used extensively as measures of 
stability (hence the term 'margin"). In systems of 
certain specific types, criteria in terms of these 
quantities have served as measurements of both stability 
and transient response. However, their use in sucha 
fashion for any system in general without extensive 
investigation is likely to yield misleading results. 


In this subsection, a slightly different point of view 
will be taken. 
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Figure III-72. Approximation by Second Order System 


The phase margin, gain margin, and M, value serve 
as bounds to the open loop transfer function in the 
region of frequencies giving the largest values of the 
closed loop transfer function, (i.e., where |Y Go) |=1), 
It is to be expected, therefore, that they can be cor- 
related with the poles and zeros of the closed loop 
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Fi gure III-73. Special Transfer Function 
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transfer function occurring near this region. If such 
a correlation can be determined, then the region where 
ly (ja)| is of the order of 1 can be approximated along 
with those regions defined by (III-24) and (I-25) (i.e., 
| ¥ (ja) | «1and| Y(ja)|>>1). The closed loop transfer 
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Figure [II-74. Commercial Model Root Locus Plotter 
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Figure [I][-75. Northrop Model Root Locus Plotter 


If the servo system is such that only one break from 
a -20 db/dec slope to a -40 db/dec slope occurs in the 
region where | Y (ja) | «1, the closed loop transfer 
function in that region is normally approximated by a 
quadratic factor (see figure III-72). 


In this case, the closed loop transfer function looks 
like that of a second order system. Ina second order 
system, the maximum magnification ratio is given by: 


1 


2¢j1- 


and occurs at a frequency 


(111-49) uM, - 


(II1-50) wea, Jl- 2% 


where ¢ =» damping ratio and w = undamped natural 
frequency. (III-49) is plotted (in db) in figure A-19, 
and (I-50) is plotted in figure A-12. Examining the 


transient responses of second order systems, figures 
A-1 and A-2, it is noted that the overshoot tends to 
become excessive for values of (<0.4. For good 
transient response, therefore, the value of M, for such 
a system should be from 1.2 to 1.6. (1.7 db to 4 db). 


Since many servos are reasonably close to that of figure 
IlI-72 in the regions where |Y(jw)|~1, it is a widespread 
practice to use the second order system peak (@,) as 
a specification of transient response. The phase margin 
can be discussed in a similar fashion, with repre- 
sentative values of 30°'to 40° being considered reason- 
able. For gain margin, values of 0.6 to 0.9 (-4.5 db 
to -1 db) are often quoted as being adequate. 


There are many exceptions to the accurate use of 
M.,, gain margin, or phase margin criteria in predict- 
ing transient response of systems. For example, a 
closed loop transfer function of the type shown in 
figure III-73 has the form (if minimum phase) of (I-51). 
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The M, value in this case can be used only to estimate 
the response time of the quadratic mode, whereas the 
actual response time will be determined almost en- 
tirely by the value of 7, if M, is a reasonable value. 


K (7,8 ¢ 1) 


(111-51) 
8 2 
(7,803 +2 s+!) 


Z(8) «= 


It is logical to conchide however, that M,, gain margin, 
and phase margin criteria give reasonable answers 


about the transient response in the immediate region 


of the modes they partially define. If (I-24) and 
(IlI- 25) are also used, a fair idea of transient response 
can then be obtained in many practical cases with com- 
paratively little effort. However, since the effort 
required to make a much more complete analysis by 
the open loop-closed loop, or even the root locus 
method, is but little more, it is recommended that 
these more exact methods be used for the first solutions 
of any new system. From this first solution, M,, gain 
margin and phase margin criteria can be defined and 
used to minimize the effort required for the following 
analyses. 
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CHAPTER IV 
SYNTHESIS 


SECTION 1 — INTRODUCTION 


(a) GENERAL 


A8S a general term, synthesis may be defined as the 
process of combining elements into a unified whole. 
A servo system may be considered as the combination 
of two basic portions — a controlled element anda 
controller. The controlled element is characterized 
by output quantitles to be controlled and input quantities 
to which control is applied. The controller has three 
functions, namely, sensing, actuation, and equalization. 
The first of these is performed by sensors, or elements 
capable of detecting the output quantities to be con- 
trolled. The second function requires actuators, or 
elements capable of applying control. The third 
function, equalization, includes all of the means re- 
quired to connect or modify the performance of any 
of the system elements and of the overall system to 
achieve satisfactory system operation. In summary, 
the basic functional portions of a servo system are: 
1. The controlled elements 
2. The controller elements 

a. Sensing elements (Sensors) 

b. Actuating elements (actuators) 

c. Equalization 
The most general servomechanism system synthesis 
problem is then one of designing properly both con- 
trolled and controller elements so that their union 
results in a satisfactory total system. In many cases 
the controlled element is more or less predetermined 
by factors beyond the scope of the system designer. 
In other situations, it is assumed to be known in order 
to facilitate the design process. The controlled element 
then is to be regarded as unalterable and will often 
be referred to as the "unalterable element.'' Sensing 
and actuating elements are "quasi-alterable" in prac- 
tice, since they are capable of change only by select- 
ion of a different item of the same general class. Equa- 
lization elements are completely alterable within the 
realm of physical realizability and practicality. With 
this basis, system synthesis may be defined as the 
process of determining the properties of a mechanism 
required to control an unalterable physical element 
in some desired fashion. 


(b) SYSTEM DESIGN PROCEDURE 


This subsection outlines general procedures and methods 
used to synthesize a controller. It will indicate the 
various interrelated tasks which must be accomplished 
before a salisfactory controller is developed. This 
outline of procedure is not to be construed as the only 
possible way to achieve the desired result. Rather it 


is a method that has been found to be most efficient over 
an extended period of time and is in a contimal process 


of development. The basic premise is that proper and 
efficient design must be firmly founded upon physical 
understanding of system and component characteristics. 


A direct corollary is that physical understanding is 
greatly enhanced by extensive use of mathematical 
models of the system components. 


The aim of servo system design is to integrate com- 
ponents into a functional system. In achieving this end, 
the designer must 
1. Establish system requirements. 
2. Synthesize a system meeting the requirements, 
i.e., select and integrate components into the func- 
tional system. In this process, the designer must 
a. "Live with" the unalterable elements. 
b. Select or design the best quasi-alterable ele- 
ments (sensors and actuators) available. 
c. Design equalization to tie the unalterable and 
quasi-alterable elements into a well integrated 
functional system meeting the system requirements . 


With this background, it is now possible tc discuss the 
various steps of controller design, remembering that 
they are chronological in a general sense only; there 
must be considerable feedback and interrelation ex- 
isting betwcen steps. 


i. SPECIFICATION OF: 

a. Purpose of system. 

b. General system requirements. 
Discussion: The requirements and purposes of a 
system are partially derivable from operational con- 
ditions imposed upon the equipment. Certain other 
requirements are somewhat adjustable and are usually 
set forth as design objectives. Still others are evolved 
during the design process. 


2. DETERMINATION OF UNALTERABLE ELEMENT 
(CONTROLLED ELEMENT) CHARACTERISTICS. 
Discussion: The defining characteristics and opera- 
tional features of the unalterable element should be 
thoroughly understood and completely defined. The 
physical quantities to be controlled must be identified, 
and the means through which control can be imposed 
must be established. 


3. DETERMINATION OF BASIC FUNCTIONAL BLOCK 
DIAGRAM. 

Discussion: An intimate knowledge of the system re- 
quirements and the unalterable element characteristics, 
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coupled with a detailed understanding of possible means 
of achieving the ends required, is the main basis for 
selecting and evolving the proper functional diagram . 
It is at this point that experience and understanding of 
physical systems pay off most heavily. In this phase 
a type of control is established. The ability to measure 
the controlled variables and to control the unalterable 
elements accordingly must be carefully considered. 
Preliminary equalization is established by the manner 
in which connections between elements are made. 


4. SELECTION OF ACTUATING AND SENSING ELE- 
MENTS 

Discussion: In the functional block diagram phase, the 
type of control has been determined, at least as to the 
general types of sensors to be used. The unalterable 
elements and system requirements largely determine 
the characteristics required of the actuating elements; 
this narrows the field of possible actuators down toa 
Small group of units available (or capable of develop- 
ment in an allowable time Span). Therefore, a very 
few versions of sensors and actuators need be con- 
sidered further. It is the selection of these choice few 
that is desired in this phase. Final selection is made 
after a considerable portion of the next phase is com- 
pleted for all likely combinations. 


9. DETAILED SYSTEM STUDY 

a. Studies using "normal" unalterable element 

characteristics. 

b. Studies using critical abnormal unalterable 

element characteristics. 
Discussion: These studies are pebiormied by the use 
of one or all of the analysis techniques of Chapters III 
and VIII as tools for use in experimenting with the 
mathematical model. The modifying characteristics 
of the remaining equalization are found by judicious 
use of trial and error experimentation with these 
models. Hence, the study phase usually consists of 
many detailed computations using the root-locus, 
open loop —closed loop logarithmic, and analog com- 
puter methods or other means which may be available . 
In the latter portions of the study, as much information 
about the physical system is used as is possible, in- 
cluding all important non-linearities. All assumptions 
are carefully listed in great detail for later verifi- 
cation by actual tests. 


6. SYSTEM DETAIL DESIGN 

Discussion: This phase consists of taking the mathe- 
matical models of the equalization, sensing, and actuat- 
ing elementsand designing, developing, and construct- 
ing the physical manifestations of these models. 


1. TESTS 

Discussion: This phase usually starts with individual 
component tests (which sometimes commence in phase 
4 or 5), and ends with tests on the complete system. 
The major aim is to ascertain that the actual physical 
equipment will perform in accordance with the system 
requirements and purposes. 


8. PRODUCTION DESIGN, QUALIFICATION AND 
FUNCTIONAL TESTS, ETC. 

Discussion: This phase is concerned with all of the 
items necessary to make a workable prototype system 
into a suitable production design. Organizationally, 
the people charged with this responsibility are usually 
quite removed from the original system designers. 
However, the entire effort is directed toward pro- 
duction, and this phase is as important in the overall 
system synthesis as any other. 


The above procedure for designing a controller also 
covers the complete field of servo system synthesis. 
However, this chapter is concerned only with aspects 
basic to items 1, 3, and 5. 


Restricting the discussion to basic items then limits 
the subject of synthesis, as understood here, to that 
of designing suitable equalization for a system composed 
of more or less unalterable sensing, actuating and 
controlled elements. 


(c) EQUALIZER SYNTHESIS 


The analysis problem of Chapter III was particularized 
from a very general one to the problem of finding the 
closed loop transfer function from a knowledge of the 
open loop transfer function. In this chapter, certain 
desired properties of the closed loop system are known, 
as well as the characteristics of all of the elements of 
the open loop, with the exception of the equalization. 
The problem then becomes one of determining methods 
of utilizing elements with essentially fixed charac- 
teristics in order to achieve a type of behavior that is 
in no way inherent in the element itself, by inter- 
connecting it with other elements. The third section 
of this chapter will point out some ways in which this 
can be accomplished. 


However, an objective must be clearly stated before 
this can be attempted. This objective is expressed 
in terms of the desired characteristics of the completed 
system. Therefore, the second section of the chapter 
dea!s with the methods of specifying servo system 
performance. 


SECTION 2 — SPECIFICATION OF SERVO SYSTEM PERFORMANCE 


The most complete specification of a linear system 
would be in the form of the desired system transfer 
functions. However, such specification is usually 
impractical, and would not even be useful in some 
cases. Therefore, most systems are specified in 
terms of quantities putting bounds upon some of the 
parameters occurring in the possible transfer functions, 
i.e., quantities which partially define the desired 
transfer function. Such specifications allow the system 
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designer leeway in handling the less important features 
of the system transfer function and emphasize the im- 
portant features. This section will discuss in detail 
the various quantities normally used in specifying 
linear system performance. All of these quantities 
will be correlated with the properties of the trans- 
fer function which they describe. 


Quantities of direct interest in specifying servo per- 


formance are: 
1. Degree of stability. 
2. Response time to representative inputs. 
3. Accuracy of control. 


A servo system is almost always required to be stable. 
This immediately specifies that the closed loop trans- 
fer function poles be in the left half of the s-plane 
only. In addition, a reasonable degree of stability is 
usually required, making it necessary that the dominant 
closed loop second order poles have reasonable damp- 
ing ratios. Since application of the open loop - closed 
loop logarithmic method and the root locus methods 
both lead to closed loop pole and zero values explicitly, 
the stability and degree of stabilityarealways known 
throughout any analysis problem. By the use of these 
methods, any desired damping ratio of a dominant 
closed loop mode can be easily selected directly if 
desirable. Therefore, the degree of stability require- 
ment could be set up in terms of the dominant closed 
loop mode damping ratio if such a dominant mode ex- 
ists alone. If more than one dominant oscillatory mode 
exists in the system, a minimum damping ratio require- 
ment is often satisfactory. 


The response time requirement basically fixes the 
damping times of the dominant modes, and hence, 
either the time constants of dominant closed loop 
modes or the damping ratio-undamped natural fre- 
quency products, or both. This information is also 
directly available from the use of the analytical methods 
previously discussed. 


The steady state error of a closed loop system is a 
matter of great interest in many applications and has 
often been used as a defining characteristic of servo 
systems. Consider, for example, the servo system 
of figure IV-1. 





Figure IV-1. Illustrative Servomechanism 


The error-input transfer function is given by: 


BS) ee OO, 
(IV-1) Res) " T+ ¥(8) 1 KN(S)—8"D(s) + KN(s) 


s"D(s) 


The steady state error is given by use of the final 
value theorem of the Laplace transformation as: 


(IV-2) Lim e(t) = Lim «| Me | - Lim —8---P(8)_ ag) 
t-« s-0 |1+Y(S) s-0 s"D(s) +KN(S) 


The limit as s~0 of D(s) and N(s) is, of course, equal 
to 1, since N(s)and D(s)endin1l. ° 


(IV-3) Lim e(t)= Lim s"*'R(s) 
ai : s"+K 


If R(s) is a unit step displacement, i.e. R(s) = 1i/s, 
and n>»1, the steady state error is zero. Hence, a 
servo system having an open loop transfer function 
of the form of (IV-4): 
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is called a zero position error system.* If R(s) re- 
presents an input velocity step, i.e. R(s) = 1/s2, and 
n232, the steady state error will be zero for this 
type of input also. Therefore, systems with open 
loop transfer functions of the form of (IV-5): 


i C(s) _ KN(8) 
(1v-8) Eta) * S!D¢3) 


are called zero velocity error systems. Similarly, 
if n23, the system is a zero acceleration error sys- 
tem, and so forth. 


If n=0, the system of figure IV-1 has a steady state 
error to a unit step displacement input of 


(IV-6) 


Lim e(t) = Lim sE (s) = Lim s D(s) i1__i1 
t~@ 8-0 8-0 D(s)+KN(s) 5 1+¢K 


This system error can be expressed as; 


oe Soe 
(IV-7) Lio a ivk C, 


(Since R(t) in this case is a step function, Lin, R(t) is 
simply the magnitude of the step function.) C, is called 
theposition error coefficient.” Similarly, if a unit step 
velocity is applied to a zero position error system, the 
steady state position error is: 


(IV-8) Lim e(t), 1 GR(t) | q dR(t) 

ve K dt v dt 
where Lim dR(t)Aitis simply the constant velocity of the 
input; dnd C, is called the’velocity error coefficient » 


The concept of an error coefficient may be generalized. 
to provide a very uSeful way of considering the nature 
of the response of a system to almost any arbitrary 
input. 


Consider the error-input transfer function for a general 
servo system, aS M(s). 


(IV-9) free - M(8) 


Assume that M(s) can be expanded in a power series 
in s which is valid for some values of s. Then 


(IV-10) E(s) = M(s)R(s) = AJR(s) + A,SR(s) + A,87R(s)+°*° 


The region of convergence of this power series is 
near s-0Q. Since s-0 is equivalent in the time domain 


to t-@ , an expression for E(t) as t ~™ may be 
obtained from (IV-10). It can be shown, by utilizing 


the properties of asymptotic behavior of functions, 
that (IV-10) may be inverse transformed term by term, 


* It should be noted that the term ‘zero position er- 
ror’ as given here implies that the output has zero 
steady state error only if the ‘position’ input is a 
constant in the steady state. If the input is of a 
different nature, the so-called zero position error 
system will actually have a steady State ‘position’ 
error. 
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giving 


dR( t) 7 
dt 


d2R(t) eee 
dt? 





(1V-11) He]  A,R(t) + A, A, 
t=- 


where Ay = Co. A, es Cy. Ag bed C,/2 3 and Co ’ Cy, and Ca 
are the general position, velocity, and acceleration 
error coefficients, respectively. 


To illustrate the general error coefficient concept, 
consider the simple servo system of figure IV-2. 


»~ E K(7, s+ 1) 
+ (78+ 1)(7,5 ¢* 1) py 


Figure IV-2. Simple Servomechanisa 





The error-input transfer function is given by: 


(IV-12) g(s) . 1 z T,e8 + 1)(TpS + 1 
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Since the bracketed term in the denominator is of the 
form (1+Z(s)], and since, by the binomial theorem, 


(1V-13) EET) «= 1- 2(s) + Z2(8)- +e 4 oe. 


the expression for the error may be developed into a 
power series: 


(IV-14) 
E(s) = Rs) (1. (T. tT, serena (“tea eral Yad) s) 


1¢ K 1¢ K 


Multiplying and collecting terms, E(s) becomes 
(Iv-15) 


K 
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cma - clemcemas ae 2 
é iy (re T, *Th 7, +Krt - 7) st 





or 
(1V-16) & (8) = CoR(s) + CysR(s) + SB 87R(a)+ ++ 


where C.- rer) [t.* 7-71] » and 
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Applying the inversion utilized to obtain equation (IV-11), 
the steady state error expression becomes: 


(IV-17) e(t)] = CoR(t) + cyIRCED, Ca dPR(t) ,..., 
t-e dt 2 dt2 


If R(t) is given by, say, 
(IV-18) R(t) = vt 
the steady state error is approximated by 


1 K 
(IV-19) e(t)] ae vt+ TERT (7, +7)-7,)V 


The error in the above case becomes infinite as time 
approaches infinity. 


It is of interest to note that all of the error coefficients 
are decreased with an increase in gain. An increase 
in the open loop transfer function denominator time 
constants causes an increase in the velocity error 
coefficient, while an increase of numerator time con- 
stants causes a decrease of the same error coefficient. 


In some instances a requirement that the servo be a 
zero poSition, velocity, or acceleration error device 
is imposed. In these cases, the form of the open loop 
transfer function near s-0 is, of course, fixed. Accu- 
racy requirements are often more general than this, 
however, in which cases it is usual practice to specify 
the first few error coefficients. The specification of 
error coefficients immediately puts several bounds 
upon the closed loop transfer function in addition to 
those established by the stability and response time 
requirement. 


Another specification occasionally imposed upon a 
system is concerned with its response to disturbances 
and "unwanted inputs." If the unwanted input is random, 
there are methods of determining the root-mean-square 
error due to the disturbance. These methods are con- 
Sidered in detail in Chapter V. For the present, it is 
sufficient to note that the specification of an allowable 
rms error due to unwanted inputs also places bounds 
upon the closed loop transfer function. 


In view of the above discussion, it is clear that specifi- 
cations in terms of actual operating conditions may be 
set up for a given system, and that these requirements 
define certain properties of the complete system trans- 
fer function. If the system unalterable elements are 
then identified, it becomes possible to consider the 
methods of connecting some other elements such that 
the characteristics of the combined system meet the 
specified system objectives. The next section discusses 
the basic forms of modification which are used in 
actual system synthesis. 


SECTION 3— EQUALIZATION 


Section IV-1 has defined equalization as the process 
of modifying performance of elements by external 
means. Section IV-2 has discussed some of the re- 
quirements which would be imposed by specifications 
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on the performance of a servomechanism. This sec- 
tion will discuss the methods of equalization avail- 
able for modifying the performance of elements or 
systems. 


It must be recognized that there are an infinite number 
of ways in which an element or system can be modified. 
No attempt will be made here to categorize all possible 
methods of modification. Instead, the discussion will 
emphasize some of the basic underlying operations 
that are physically possible and the fundamental 
physical forms which can be obtained by use of these 
operations. Synthesis then consists of properly combin- 
ing these forms so that the combination meets certain 
specific requirements. This is usually a cut and try 
process in which characteristics are assumed for 
certain alterable elements, the combination analyzed, 
changes made, another analysis performed, etc., 
until satisfactory performance (and hence modification) 
has been achieved. The trial and error process in- 
volved is essentially a series of experiments performed 
on paper, using mathematical models. An exception 
to this experimental process is discussed in Chapter V, 
where "optimum" synthesis procedures are developed 
which lead directly to a system meeting a specific 
criterion. 


The most basic operational functions that are available 
for making modifications may be reduced to: 

1. Addition (or subtraction) 

2. Multiplication (or division) 
These operations are denoted graphically in figure IV-3. 


: 
Subtraction Addi tion Multiplication 


Figure IV-3. Basic’ Operations 


From these operations, three basic structure forms 
may be derived as shown in figure IV-4. 





Figure IV-4. Basic Structures 


Note that any of the blocks Y,, Y,,or Yc may be re- 
placed by a line (or wire), which reduces the block to 
the trivial case of multiplying by one. 


As mentioned above, the basic structure forms shown 
in figure [V-2 may be used in an indefinitely great 
number of ways to modify a system or element. There 
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are, however, several simple combinations of the 
basic structures which may be considered as funda- 
mental in that they may be obtained by combining the 
basic forms using each only once. If multiplication 
and subtraction are used only once, the single loop 
feedback combination of figure IV-5 is formed. (Using 
the addition structure instead of the subtraction leads 
to essentially the same results.) If multiplication, 
addition, and subtraction are used only once ina 
structure, the open loop — closed loop structures of 
figure IV-6 are obtained. 





Cf, _ Yate 
R 1+Y,¥, 


Figure IV-5. Single Loop Feedback 
Combination 


All of the structures, both basic and simple com- 
binations, can be utilized to modify the characteristics 
of an element or system. These modifications may 
be logically looked at as transformations. Some simple 
modifications to an element derivable from the basic 
Structure and first simple combination are given below. 
Y is the basic element, with Y, and Y, being modifying 
(or equalizing) elements. 
1. From Basic Structural Forms: 


a. Yr Ye Y, 





b. rm 7y, Y 


2. From Single Feedback Loop Structure: 


a.y~ : 
1+Y - 
b. y-_—L 
1+Y as 


1+ Y,Y, - 


d.y~y —L > 


a 
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e.Y ~ —1_ : hoy- 2 : 
1+¥ ¥, ~ 1+YY, f 


The open loop - closed loop structures lead to many 


f.y- astra -{¥,} "9 ‘~ ; more transform pairs. 
1+ YY, . 
In synthesis work, an element Y is to be modified to 


achieve some particular specified form. Experience 





Y . and knowledge of basic forms usually lead to the proper 
@.Y~ rh. “ta connections, with trial and error mathematical model 
3 . experiments leading to the characteristics of the 

modifying elements. 


Cc a ¥o(Yyt Yp) 
R 





Figure IV-6. Open Loon —Closed Loop Structures 
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CHAPTER V 
OPTIMUM SYNTHESIS METHODS 


SECTION 1 - INTRODUCTION 


In the introduction to Chapter IV, System Synthesis 
was defined as the process of determining the 
properties of a mechanism required to control an 
unalterable physical element in some desired 
fashion. The "desired fashion" for many control 
problems may be described by a set of specifi- 
cations which define minimum tolerable degree 
of stability in terms of damping ratio, maximum 
tolerable response time to a representative input, 
accuracy of control, etc. Synthesis procedures 
which have been developed to establish systems 
that meet these specifications generally involve 
trial and error techniques, and these techniques 
become laborious as the system under consider- 
ation becomes complex. 


In Section 2 of this chapter, a method of synthesis 
is developed which is directed toward eliminating 
the empirical approach by providing a definition 
of the system transfer function very early in the 
design procedure. This method is based on the 
single requirement that the transient error to 
step inputs be minimized and is called "Optimum 
Transient Response.''* It is interesting to note 
that this single requirement contains implicitly 
the requirements imposed by specification of 
stability, damping ratio, and response time. 
In the development of the method, eight mathe- 

matical criteria for optimum transient response 
to step inputs are examined, and the superiority 
of the minimum integral of time multiplied by 
the absolute value of error, sete ldt, is demon- 
strated. Tables of standard forms for the following 
optimized systems are presented in the Appendix: 
zero-displacement-error, zero-velocity-error, 
and zero-acceleration-error (tables A-5, A-6, 
and A-7). 


Another technique considered in this chapter 


* Section 2 reproduces almost verbatim much of 
A.I.E.E. Technical Paper No. §3-249, ‘The 
Synthesis of Optimum Response: Criteria and 
Standard Forms,’ by Dunstan Graham and Rich- 
ard C. Lathrop, Reference 9. 


recognizes that many systems are subject to 
classes of inputs which may be conveniently de- 
scribed only by statistical measures. In addition, 
these inputs may contain not only a desired message 
but also spurious or unwanted signals called 
"noise.'' These signals cannot be represented 
or typified by inputs such as a step function, and 
system design based upon response to such inputs 
might be wholly unsatisfactory. The methods 
discussed in previous chapters are inadequate for 
handling this type of problem, and new techniques 
have therefore been developed. They are discussed 
in Sections 5 and 6. 


Before these techniques can be reviewed, an under- 
standing of some concepts and mathematical back- 
ground, not discussed elsewhere in this volume, is 
desirable. Sections 3 and 4 ofthis chapter consider 
the concepts of "Correlation Functions" and ''Spec- 
tral Density,'' respectively. The Appendix, 
Sections A VI through A IX, includes a brief dis- 
cussion of Fourier Transforms, the Parseval 
Relation, Delta Functions, and Memory Functions. 


Section 5 describes a method, developed by 
N. Wiener, for obtaining that transfer function 
which minimizes the mean square value of the 
difference between the system output and a time 
displacement of the system input. The reason 
for choosing the mean square error criterion 
and the practical applicability of the technique 
are also discussed in this section. 


Section 6 describes an optimum system synthesis 
method developed by R. S. Phillips. The mean 
square error criterion is also applied in this 
method. The error, however, is defined in a 
more general fashion than in Section 5. It is de- 
fined as the difference between a desired output 
and the actual output. Furthermore, the method 
used in this section differs from the method em- 
ployed in Section 5 in that the basic stracture 
of a system is assumed, andthe error is minimized 
by adjustment of controllable parameters. 
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SECTION 2 - OPTIMUM TRANSIENT RESPONSE 


The choice of specific design variables in the 
synthesis of a system depends completely upon 
the criteria which are applied in judging how well 
the output follows the desired output. It would 
be desirable to develop a single figure of merit 
or criterion to judge the goodness of the transient 
response of a system. 


Ideally, such a criterion should have three basic 
attributes: reliability, ready applicability, and 
selectivity. It should be reliable for a given class 

of systems so that the user can apply it with con- 
fidence to any system within the class. The 
criterion should also be easy to apply. A graphical 
construction, an analytic expression, or the analog 
of a mathematical expression might be acceptable 
forms of acriterion. Finally, the criterion should 
be selective; that is, it should indicate a dis- 

cernible difference between good systems and 
those which are not so good. 


This section is concerned with the transient per- 


formance of those systems which have a steady 
state displacement error of zero when subjected 
to an input step function. An example of sucha 
system would be a simple linear second order 
system which has the transfer function 


C(s) . 1 
(V-1) R(s) s +20 se] 
OW, =p 


Figure V-la shows the error responses ¢(t) = 
r(t)- c(t) for this system for various values 
of damping ratio ¢, when r(t) is a unit step func- 
tion. Note that when error is so defined, the 
desired output is the input. A perfect response 
would be an output step function identical to the 
input with no error at any time. The actual re- 
sponses of figure V-1la differ from the perfect 
response in various ways. In particular, certain 
characteristics of the responses provide a measure 
of the degree to which the responses approximate 
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Figure V-1. Step Function Response of Second Order Systems and Figures of Merit 
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Figure V-2. Measures of Performance - Step Function Responses Second Order Systems 


the ideal response. Three commonly used char- 
acteristics are (1) the time for the error to reach 
its first zero, (2) the amount of the first overshoot 
expressed as a percentage of the initial error, 
and (3) the solution or response time (time for 
the error to reach and remain within 5% of 
its initial value). These three quantities are 
plotted in figure V-2 as functions of damping 
ratio ©. It is clear that the percent overshoot 
and the time to first zero are conflicting charac- 
teristics in the sense that their minimum values 
occur at different damping ratios. If these two 
characteristics of the simple second order re- 
sponses were used as criteria, the design problem 
would consist of selecting that value of ¢ which 
affords the best compromise between small over- 
shoot and fast rise time. On the other hand, the 
solution time can be used alone as a criterion of 
performance since it combines, in a sense, the 
properties of the other two characteristics. The 
solution time is a minimum for a damping ratio 
of about 0.7 in a simple second order system. 
The applicability of the solution time criterion 
is now restricted to linear second order systems 
although it may be applied to higher order and 
nonlinear systems as well. 


The solution time criterion, as applied to linear 
second order systems, appears to have some of 
the characteristics of an ideal criterion. It is 


reliable in that it selects a damping ratio of about 
0.7, a value which is commonly considered to 
be optimum. It is fairly easy to apply, given the 
time response of a system. It is also selective in 
that the difference between the optimum value and 
other values is easy to distinguish. However, 
it gives an exaggerated picture of the difference 
between the "goodness" of a system with a damping 
ratio slightly less than the "optimum" and the 
"goodness" of one with a damping ratio slightly 
greater than the "optimum." 


Several other criteria have been used for evaluating 
the transient performance of zero-displacement- 
error systems which are subjected to input step 

functions. One such criterion is based on the 

minimization of the integral 


(V-2) I, + feat 


This criterion, called the "control area,'' appears 
to be satisfactory for system responses which do 
not overshoot. For systems which have a chara- 
teristically undamped response, however, the 
control area gives an erroneous indication of merit 
since overshoots decrease rather than increase 
the value of the integral. 


Curve A of figure V-3 shows the value of the cri- 
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Figvee V-3. Criteria for Step Function Response - Linear Second Order Damped Systems 
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terion 1, as a function of the parameter ¢, fora 
system with the transfer function of equation (V-1) 
subjected to a unit step function input. It can be 
seen that the minimum value of I, occurs at the 
damping ratio © = 0. Such a system could hardly 
be described as optimum. The failure of this 
criterion to select a reasonable linear second 
order system is sufficient grounds for rejecting 
it from further consideration. A modification of 
this criterion to provide for weighting of the error 
with time is given by the integral 


(V-3) I, > f teat 


The weighted control area, I2, provides an in- 
creasingly heavy penalty for a sustained error, 
and, as before, that system is considered optimum 
which produces a minimum value of I,. Curve B 
of figure V-3 is a plot of the value of this criterion 
applied to the second order system. It can be 
noted that the minimum value of the weighted 
control area occurs at the damping ratio (= 0. 
Therefore, this criterion fails in the same way as 
the control area criterion. 
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The integral 
V-4 ee ee 
(V-4) I, J e? dt 


is another possible figure of merit. In this case 
either positive or negative errors due to over- 
shoots will produce positive contributions to the 
value of the integral. If this criterion is applied 
to the step function responses of a simple linear 
second order system, curve C of figure V-3 is 
the result. The minimum criterion value occurs 
at { = 0.5, which is not an unreasonable damping 
ratio. Furthermore, the criterion can be handled 
analytically or mechanized with relative ease on 
an analog computer. It does however exhibit 
limited selectivity. 


Another figure of merit is given by the integral 
v-5 Pe i 
(V-5) 1, - Jf lelat 


Curve D of figure V-3 shows the results of testing 
this criterion in connection with the transient 
response of the simple linear second order trans- 
fer system. The minimum value of the criterion 





/ | 





1.2 1.4 1.6 1.8 2.0 2. 2 2. 4 


Damping Ratio, Cf 


Figure V-4. Additional Criteria for Step Function Response - Linear Second Order Output Damped Systems 


V-5 


Chapter V 
Section 2 


1, 25 


- 75 


Response 





0 5 10 L 


Nondimensional Time, w,t 


Figure V-5. Step Function Responses - Error Rate Damped Second Order Systems 


re, ee eae] , =o a. : ia (os { Cama 


emm@@@ <@i-mmm - gpm 


branal 


eo So eee 


ene 
a 








occurs at about € = 0.7. It is moderately selec- 
tive, and although it is not analytic, it is easily 
mechanized on ananalogcomputer. Iftime weight- 
ing is introduced, this criterion is modified to 


(V-6) I, jr tlel dt 


This function is known as the integral of time- 
multiptied absolute value of error (itae) criterion. 
If, as before, it is tested on the simple second 
order system, curve E of figure V-3 is the result. 
The minimum criterion value occurs at G = 0.7. 
The itae criterion is selective and easy to mecha- 
nize on the analog computer. Applications to 


other systems to test its reliability will be dis- 
cussed below. 


Still other figures of merit can be formed with 
more complex combinations of error and time 
weighting. Three such criteria are: 


(V-7) I, = jt e? dt 
(V-8) L f tietat 
(V-9) Il, * frt3| elt 
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The values of these criteria as functions of © for 
the step function responses of the simple second 
order system are presented in figure V-4. Al- 
though these criteria show promise with respect 
to reliability and selectivity, they are excluded 
from further consideration because they are diffi- 
cult to handle either analytically or on the analog 
computer. 


Of the several criteria mentioned above, only 
those defined by equations (V-4), (V-5), and (V-6) 
are considered worthy of further discussion. 
In order to test the general applicability of these 
three criteria, they are applied to a second order 
linear zero-velocity-error system which has the 
transfer function 


(V-10) Cis) _ Ms 


The responses of such a system to a unit step 
function input are shown in figure V-5 for various 
values of the damping ratio ¢. It is interesting 
to note that, as the damping ratio is increased 
above one, the response continues to improve. 
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The values of the three criteria are plotted as 
functions of the damping ratio ¢ in figure V-6. 
All three criteria indicate improvement in per- 
formance as the damping ratio is increased. 
The itae criterion indicates greatest over-all 
selectivity. 


As a further test of the general applicability of the 
criteria defined by equations (V-4),{ V-5), and 
(V-6), they have been applied to linear third order 
systems characterized by the transfer function 


C(s) 
(V-11) R(8) 334 bs2e cs¢+ 1 


The responses of such a system to a unit step 
function are shown in figure V-7 for various com- 
binations of the parameters b and c. The results 
of the integral of error squared and integral of 
absolute value of error criteria as applied to this 
system are shown in figure V-8. It is clear that 
these criteria fail in the selection of the optimum 
system parameters. Additional tests indicate 
that these criteria become even less selective for 
higher order systems, and it is doubtful whether 
they are suitable for evaluating the transient per- 
formance of more general systems. 


The itae criterion, on the other hand, retains 
good selectivity for the third order system, 
as evidenced by figure V-9. The minimum value 
of the criterion occurs for the third order system 
which has the parameters b = 1.75 and c = 2.15. 
Note in figure V-7 that the step function response 











of a system with these parameters appears quali- 
tatively to have excellent characteristics of fast 
rise time and small overshoot. | 


(a) ZERO-DISPLACEMENT-ERROR SYSTEMS 


When the minimum it ae criterion is applied to the 
determination of the optimum unit numerator 
transfer functions of various orders, the standard 


forms of table A-5, page A-13a of the Appendix, 


are obtained. The corresponding pole locations 
on the s- plane, the step function responses, and 
the frequency responses are shown in PEMnee 
V-10, V-11, and V-12., | 


In the case of linear systems with unit numerator 
transfer functions, the itae criterion may be 
represented as a surface in a multidimensional 
space which has the dimensions of the transfer 
function coefficients. The surface (line), its 
shape, and its minimum point have already been 
illustrated for the second and third order cases 
in figures V-3 and V-9. The multidimensional 
surface itself cannot be graphically represented for 
systems of order higher than the third. Instead, 
figures V-13 and V-14 show sections through the 
surface for the fourth and fifth order systems. 
It may be seen from these figures that the adjust- 
ment of the coefficients of the lowest powers of 
the complex variables in the standard form is the 
most critical, both with respect to the character 
of the step function response, and with respect to 
the value of the criterion. 
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(b) ZERO-VELOCITY-ERROR SYSTEMS 


The class of linear systems with unit numerator 
transfer functions, while basic,represents only a 
small fraction of possible linear systems. The 
numerators of possible system transfer functions 
are almost infinitely variable. By confining atten- 
tion, however, to systems with no steady state 
displacement error, the numerator polynomials 
are limited to those which include a constant term 
of unit magnitude. This would still leave open 
for consideration a large number of polynomial 
numerators of an order equal to or less than the 
corresponding denominator if an arbitrary choice 
of polynomial coefficients were allowed. In control 
system design practice, however, there are two 
limiting cases, the zero-velocity-error and the 
zero-acceleration systems. 


The steady state error of a servomechanism may 
be shown to be 


fy areas oa Cad’r 
es ¢ — ———— 
eCh) = Sor * Sige’ 2 dt? 


In terms of the generalized transfer function con- 
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stants shown in the transfer function 


C(8) Py d® + Bree PLM oP AER 
(V-13) ——— 8 a oe ed 
R(S) QAN? + Qh Dee eQod® + QA % Qo 








where displacement error coefficient C, = 0 
when Po = %, velocity error coefficient C, = 0 
when P, = Q,, and acceleration error coefficient 
C,*0 when P, = Q,. 


Therefore, in considering the zero-velocity and 
zero-acceleration-error systems as limiting cases 
from among all the possible systems with poly- 
nomial numerator transfer functions, only two 
different numerators for each order of the de - 
nominator will be selected. The optimum transfer 
functions (standard forms) for systems with nor- 
malized transfer functions 


C(s) 1 
-14)——— = 
(V-14) Ris) 3" +q,_,89 14-.-4q,87+q,8¢ 1 


s"+q,.,8 
have already been found. The possibilities of 
finding standard forms for zero-velocity-error 


O 
qth ¢j 








Pole Locations - Optimum Unit Numerator Transfer Systems 


Chapter V 
Section 2 


1, 25 


2°¢ order 





g 


0 


; : 
S 


Nondimensional Time, w,t 


Figure V-11. Step Function Responses - Optimum No Lead Servos 


V-12 


— thot ot oto Jo JU ew Do li tt 


+10 


Gain in db 


-0 
Gain 

-———-—Phase Angle 

-2 


0.2 0.5 





1.0 


Chapter V 
Section 2 


Phase Angle in Degrees 


Nondimensional Frequency 


Figure V-12. 
systems characterized by the transfer function 


C(s) . q,8+ 1 
(V-15) R(s) 87+ Q,. 80 +++ 4,874 G,8¢ 1 
and for zero-acceleration-error systems with the 
transfer function 


C(s) Q,87 + 48+ 1 


(¥-16), 7 Bho Gg, Ble. 00,88G, 8+ 1 


will now be examined in turn. 


Figures V-5 and V-6 have already been presented 
to show the possible responses of second order 
zero-velocity-error systems andthe corresponding 
values of the itae criterion. An arbitrary selec- 
tion of the parameter € = 1.6 as optimum may be 
made on the basis that further increasing of the 
damping parameter results in negligible improve- 
ment of the response. 


Very much the same situation obtains with regard 


Frequency Response Functions - Optimum Unit Numerator Transfer Systems 


to the third order zero-velocity-error system with 
the transfer function 


C(s) esl 
Oral) R(s) ” 83 4bs2+cs¢ 1 

For any given value of b, the step function re- 
sponse will improve indefinitely as the parameter 
e is increased. The value b= 1.75 is optimum 
according to the itae criterion, and the value 
e = 3.25 may be selected as marking the onset 
of diminishing returns. 


The standardforms corresponding to the minimum 
value of the itae criterion for zero-velocity-error 
systems through the sixth order are shown in 
table A-6, page A-13a, of the Appendix. The 
corresponding responses to step functions are 
illustrated in figure V-14. Large peak overshoots 
and rapid accelerations are concomitants of zero- 
velocity-error. The alternatives which use peak 
overshoot as a criterion tend to have a persistent 
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error which the itae will not tolerate. A com- 
cromise which may have some merit in this case 
is afforded by the zero-velocity-error systems 
which have transfer function denominators identical 
to those of binomial systems. (See the standard 
form of table A-8, page A-13a, of the Appendix. ) 
The step function responses of these systems 
are presented in figure V-15. Note that while 
the responses exhibit less overshoot and less 
rapid accelerations than the responses of figure 
V-14, they are, at the same time, appreciably 
slower. 


(c) ZERO- ACCELERATION-ERROR SYSTEMS 


The case of the third order zero-acceleration- 





0. 


i) 


0 ) 


error system is similar to that of the third order 
zero-velocity-error system in that the itse cri- 
terion diminishes in value indefinitely as the value 
of the b parameter is increased. The value 
c= 4.9 is optimum, andthe value b - 3.0 marks 
the point where little improvement in response 
results from further increases in this parameter . 


Other standard forms for zero-acceleration-error 
systems are shown in table A-7, page A-13a, of 
the Appendix, and the corresponding step function 
responses appear in figure V-16. As in the case 
of the zero-velocity-error systems, the step 
function response, while "best" according to the 
itae criterion, may still leave something to be 
desired with respect to peak overshoot. The 
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Figure V-15. Step Functioa Responses - Binominal Zero-Velocity-Error Systems 


es ee) ete_et et ot cS WJ dc Kw ed vb vd Cb ce cb to cg 






ING 


1 
yi | 


Chapter V 
Section 2 


binomial sero-acceleration-error systems, there- 
fore, may again prove to be a suitable compromise . 
The step function responses of the binomial zero- 
acceleration-error systems are shown in figure 
V-17. 


(ad) APPLICATION OF THE CRITERION AND 
STANDARD FORMS TO DESIGN 


If a standard form is available for the type of 
transfer function involved in a particular design 
problem, its use represents a simple, powerful, 
and accurate synthesis procedure. The elementary 
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steps involved are: 


1. Developthe system transfer function, leaving 
in literal form the constants which may be ad- 
justed by design. 

2. Normalize the transfer function (equivalent to 
a time scale change in the time domain). 

3. Solve algebraically for the values of the 
design variables which will make the transfer 
function denominator conform numerically to 
the appropriate standard form. 

4. If itis a matter of choice, the real time 
scale of the response may be adjusted by the 
selection of suitable design variables. 
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Figure V-17. Step Function Responses - Binominal Zero-Acceleration-Error Systems 
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In those cases where standard forms are una- 
vailable for the exact type of transfer function 
involved, the use of the most nearly approximate 
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standard form will lead to a very rapid estimate 
of suitable adjustments. This estimate may then 
be refined by other methods. 


SECTION 3 - CORRELATION FUNCTIONS 


This section introduces the concept of correlation 
functions and presents a discussion of their sig- 
nificance, method of calculation, and physical 
application. The following topics are treated: 
(a) Autocorrelation Functions 

1. Interpretation and Origin 

2. Statistical Concepts 

3. Formal Definition 

4. Some Useful Properties 

5, Examples of Theoretically Derived Autocor- 

relation Functions 

6. Method of Computing Functions from Em- 

pirical Data 
(b) Cross Correlation Functions: Definitions and 
Properties 


It may be noticed that correlation functions are 
divided into two classes: (a) autocorrelation func- 
tions and (b) cross correlation functions. The 
discussion of cross correlation functions is brief 
since many of the notions concerning autocor- 
relation functions are also valid for cross corre- 
lation functions. 


(a) AUTOCORRELATION FUNCTIONS 


1. INTERPRETATION AND ORIGIN 

Autocorrelation functions are functions of basic 
interest in the statistical method of system syn- 
thesis. In this theory, which effects an optimum 
compromise between a message input and all 
unwanted disturbance inputs to a physical system , 
autocorrelation functions arise very naturally. 


All unwanted inputs are called noise, and are 
generally considered to be statistical in nature . 
Since a physical system is usually synthesized 
to accommodate a whole group of message inputs, 
rather than just one, the message can also be 
considered statistical in nature; that is, although 
only one message input is applied at any time, 
the system must also be capable of handling any 
other of the group, each of which may be very 
different in character. Since a message input 
can be chosen arbitrarily from the group, the 
group can be treated statistically. 


As an example of this idea, consider the group of 
message inputs of the form 


(V-18) X,(t) = sin(t + 6) 


In this group, all messages are sinusoidal in 
nature although particular messages may differ 
in phase. The system is therefore designed to 
accommodate all messages of the form given by 
equation (V-18); and because of the freedom allowed 
in selecting a phase angle, advantage can be taken 
of the statistical properties of the message group. 


Autocorrelation functions are functions of the 
message or noise signals. They provide one of 
the properties which characterize statistical be- 
havior; that is, they furnish a measure of the 
correlation between the behavior of a signal at 
time t and its behavior at some time t+t in 
the future. Actually, these functions do not repre- 
sent a new concept. They are a logical extension 
of the so-called correlation coefficients found in 
elementary statistics. 


The formal definition and properties of these 
functions (found in Subsections a3 and a4, respec- 
tively) can be more fully appreciated by recalling 
some of the concepts of elementary statistics. 
The more important concepts are discussed in 
the next section. 


2. STATISTICAL CONCEPTS 

RANDOM VARIABLE. If a chance method of 
choosing a point on a given line is such that the 
point is equally likely to lie anywhere on the line, 
the point is said to be chosen purely at random. 
If the condition of equal likelihood is 5 not satisfied, 
the chosen point is random but not purely random. 
For example, if a perfectly balanced wheel is spun 
with a completely arbitrary force and allowed to 
come to rest under a small amount of friction, 
the point on the circumference which then lies in 
some prespecified direction from the center of 
the wheel is a purely random point on the circum- 
ference. In contrast, if the wheel were not per- 
fectly balanced, the point on the circumference 
would be merely a random point. 





A random variable is one whose values over a 
given range are determined by the positions of 
corresponding random points. It might be noted 
that a random variable is frequently referred to 
as a "stochastic variable"; the terms are equiva- 
lent. A random function is a function of one or 
more random variables. 
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PROBABILITY. Probability can be thought of as 
a measure of the likelihood that an event will 
occur. It is often expressible as the ratio of the 
number of possible favorable outcomes of an event 
to the total number of possible outcomes. If an 
event can have with equal likelihood a favorable 
outcome ins ways and an unfavorable outcome 
in f ways, then the probability, p , of a favorable 
outcome in any trial is given by 


s 
sf 





Since sand f are nonnegative integers, not both 
zero, p is anumber between zero and unity. 
Also, when s = 0, p = 0; that is, a favorable 
outcome is impossible. When f- 0, p =1; that 
is, a favorable outcome is a certainty. 


Some properties and rules concerning probability 
are stated below: 

1. If p is the probability of a favorable outcome 
of an event, then 1 -p_ is the probability of 
an unfavorable outcome. 

2. If p(E,) isthe probability that an event E, will 
have a favorable outcome and Pp, ,(E,) is the 
conditional probability that an event E, will have a 
favorable outcome on the hypothesis that E, hada 
favorable outcome, then the probability p(E, and 
E,) that both £, and E, will have favorable out- 
comes is(p(E,)] (Pg, (E,)]. 


3. If £, is independent of E,, 
p(E, and E2) = [(p(E;)) (p(E2)]) 


(In both 2 and 3, p(E, and E,) is called a "joint 
probability. '') 

4. Suppose E, and E, are mutually exclusive 
events; that is, the occurrence of E, prohibits the 
occurrence of E, and conversely. Then 


p(E, or E,) = p(E,) + P(E) 


As an example of a probability, consider the event 
of casting one die. The total number of outcomes 
possible is six. Since ''2" can occur in only one 
way, the probability that in one casting a "2" will 
be obtained is 1/6. 


As an example of the use of properties 3 and 4 
listed above, suppose two dice are cast in suc- 
cession, and it is desired to know the probability 
that an ''11"' will be obtained. This can happen in 
two ways: either E,, the first die will be a "6" and 
the seconda ''5,""or E., the first will be a ''5" and 
the second will be a "6." Since the outcome of 
each casting is independent of the other, by prop- 


V-20 


erty 3) p(E,) = (1/6)(1/6) = 1/36, p(E,) 
= (1/6) (1/6) = 1/36. Since E, and E, are mutu- 
ally exclusive, by property 4 the desired probabil- 
ity is D(E, or E,) = (1/36)+(1/36) = 1/18. 


Probability density functions are defined in the 
following way: Let x be some random variable 
defined between (-~, ©) . Thendefine [f,(x) 

in such a way that for each value a, f,(a)dx 
is the probability that agxsgaedx, £,(x) 

is called the "probability density function of x." 
A property of f,(x) is that the total probability 
sot, (x)dx = 1. 

This concept can be extended to two or more 
dimensions. Let x and y betworandom variables , 
each defined on some given interval, say both on 
Co2 2) Then f,(a,b)dxdy is the joint proba- 
bilitythat as x<aedx and bs ysb+edy. f(x, y) 
is called the "joint probability density function of 
x and y." The joint probability density functions 
f3(x, ¥, 2), t,(x.y.z,w), etc., are defined ina 
similar fashion. 


An example of a probability density function is 
the so-called "normal" density function in one 


dimension, 
1/x-n\? 
1 -a— 
nO) Son eae) 





the graph of which is shown in figure V-18. The 
constant m is seen to be at the maximum of f,(x) 
and is called the 'mean" or ''expected" value of x. 
The constant o is such that approximately 68% 
of the total area under the curve lies between 
m-o and m+o; o is called the "standard de- 
viation" and its square, o? , the "variance." 





Figure V-18. Normal Probability Density Function 


It is useful to introduce the notion of an ensemble . 
An ensemble is a group of functions and is usually 
of interest when it consists of a group of random 
functions of time. 


Buri do 


Resmns' 


Consider an ensemble of functions oftime {x,(t))}; 
where the values of the random variable, 9 , de- 

termine the various members of the ensemble. 
Let x,y, z,w, . . .be functional values which may be 
assumed by some member of the ensemble at times 
ty, ty, tz, ty,..., respectively. In particular, 
let f,(x, t,)dx be the probability that some parti- 
cular member lies in the range (x, x+ dx) at time 


tx. £:(x, tx) is called the first probability 
density function for the ensemble. 

Let f2(x, tx: y,ty)dxdy be the joint probability 
that some member lies in the range (x, X + dx) at 


time tx and that the same member also lies in the 
range (y, y+dy) attime ty. f2(x,tx: y, ty) is 


the second probability density function for the 
ensemble. 


Similarly, f,(x,tx; y, ty:...) is the n*® proba- 
bility density function for the ensemble. 


If the values of x,y, z,...,w are completely in- 
dependent of each other, then [,(x,t,; y,ty: z, 
ts:.-.; w, ty) reduces to the product of first 
probability densityfunctions [(f,(x, t,)] (f(y. ty)] 

° (£,(w, te)]. 


As an illustration of the meaning of a second 
probability density function, consider the graph 
in figure V-19, where a particular member x,, (©) 
is shown. As indicated, %s,.(t) does lie in the 
interval (x, Xx+ dx) at time tx andalso in (Y. y + dy) 
at time ty. f,(x, tx: y,ty)dxdy is the probability 
that this will occur for an arbitrary member of 
the ensemble. If, in particular, the number of 
members in the ensemble is finite, f2(x,t,: y, ty) 
dxdy isthe fraction of the total number of members 
which lie in (x, x+dx) at time tx, and also in 
(y, ye dy) attime ty. 


Xg q(t) | 
y+ dy 





y(t) 


t, ty t— 
Figure V-19. Second Probability Density Function 


RANDOM PROCESS. A random process is an 
ensemble of functions of time and is defined by a 
complete set of probability density functions. The 
functions themselves are not functions of time 
in the usual sense, that is, not in the sense that 
the value of a function at any time can be deter- 
mined with probability one by specifying the time. 
The functions are generally functions of random 
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causes or variables as well as time, and can at best 
be specified at a given time with a probability 
less than one. For example, a record of the 
closing market prices of a certain stock might 
be as shown below. 


pig tN 


Time—— 
Random Process of Stock Prices 


Closing 
Price ~~ 


It is apparent that a mathematical formula for 
this graph cannot be written, and its behavior is, 
to some extent, random. Although the graph is a 
function of time, it also depends for its values 
upon a number of random variables, so the closing 
price at any time outside the range of the graph 
cannot be specified exactly. 


The function described in curve shown above can be 
thought of as one member of a random process 
whose members consist of the closing price re- 
cords of many stocks over the same period of 
time. All the members need not be purely random; 
in fact, there may be some which exhibit no ran- 
domness whatever. 


Since the members of a random process may ex- 
hibit any degree of randomness, quantitative in- 
formation about the process cannot be obtained 
by exact mathematical formulae; so statistical 
methods will be used to analyze these processes. 


STATIONARY PROCESS. A random process 
whose probability density functions are invariant 
under a change inthe origin of time is a stationary 
random process, Equivalently, the first proba- 
bility density function is independent of time. The 
second is a function of the difference in time 

t,-t,. Similarly, the n** order density function 
depends only on n- 1 time differences. 


It might be noted that many processes which are 
of interest physically are stationary in character. 
As an example of this type of process, consider 
a group of measurements being made on the di- 
ameters of some mass-produced ball bearings. 
It is expected that if the measurements are made 
tomorrow (or at any other time), the results ob- 
tained will be the same as those made today; the 
nature of the bearings and the accuracy of the 
measurements do not change appreciably during 
reasonably short periods of time. In this example, 
the ensemble consists of only one member whose 
functional values are the set of measurements 
recorded on a time scale. The ensemble can be 
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enlarged by imagining a group of macroscopically 
identical measuring devices which are all measur- 
ing the same set of bearings during the same time 
interval. For this type of process, it is expected 
that samples of measurements taken from member 
to member at the same time would be indistinguish- 
able from samples taken from the same member at 
different times. This is the fundamental property 
of a stationary random process. 


ENSEMBLE AND TIME AVERAGES; ERGODIC 
HYPOTHESIS. For the ensemble of functions 
{xg (t)}, the ensemble average, “x , taken at 
time tx, is defined as 


“X= xf (x, tx) dx 


where f, is the first probability density function 
for the ensemble, and the integration is taken 
over the range of all possible functional values, 
x , of the members. 


A mean of the product of functional values taken 
at different times t, and t, can be obtained from 
the second probability density function 


“SV = ffxyfo(x, ty) y, ty) dxdy 


where f, is the second probability density function 
for the ensemble, and the integration is taken 
over all possible values of x, y. 


If the random process considered is stationary, 
‘ is independent of t,, and xy depends only on 
Te ty ie t,. 


Then “X= fx f,(x)dx 


d 
ea “SY = Sfxyf,(x%y; Tdxdy 


If x = xg(t) and Y= X%(t+T) 


where 9 is a random variable, 


then sae 
Xg(t)xg(t +T) = Xy 


THE ENSEMBLE AVERAGE THEOREM. The 
following theorem, which is stated without proof, 
is occasionally of great use in evaluating ensemble 
averages. If 


“= [x yf, (xydx 
where the random process x, depends on the ran- 


dom variable §, and [,:(x) is the probability 
density function of *,, then 
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“XG = J x(8)¢ (6) dO 


where ¢(8) is the probability density function 
for 0. 


Similarly, if x depends on n random elements 


or variables, 6,, 9,...,9n, 
ie Jfee J X(8 Ogres On) & (94, 09,--., On) 
do ;,dog,--- dan, 


In each of the above integrals, the limits of in- 
tegration are determined by the ranges of the 
variables of integration. An example of the prac- 
tical use of this theorem is given in Section 5, 
example 4. 


The time average, x, , of a given member of the 
ensemble {x, = x, (t)} is defined as 


——— Lim: 2: et 
X(t) erie Jf X,(t) dt 
aT -t 


Similarly, 


ee T 
X,(t)x,(t + T) = Jin = J. X_(t)x,(t + t)dt 


The ergodic hypothesis, which has been proved 
only for certain specialized cases, states that for 
a stationary random process, time averaging and 
ensemble averaging give the same result. The 
statement is of great practical value since it is 
usually much easier to average by one method 
than by the other. 


3. FORMAL DEFINITION 

The formal definition of an autocorrelation function 
may now be given in terms of time and ensemble 
averages. Define the time average of a member 
of arandom process, x,(t), as x,(t). Itis 
seen that x,(t) is, in general, a function of 9%. 
Define the ensemble average of the process as 
“‘KeCts; «= “XB (tS sis in general a function of t. 
For the stationary random process ({X,(t)} 
the autocorrelation function k(t) is defined as 


(VII) Ra) = KAD eey (ET) = Hy (EVAR, (ET) 


where the asterisk indicates the complex conjugate . 


As an example of the meaning of the complex con- 
jugate form, consider the ensemble of functionst 


@ 
Xo(t) = ZF An chlunt ee) 
ns-@ 


+ Hereafter, the notation {} for ensemble will 
be dropped where there is no ambiguity. 


This ensemble can be thought of as the Fourier 
series expansion of a group of functions differing 
only by a randomly chosen phase angle, 6. The 
complex conjugate is 


= -J(w,t+0) 
Xy(t)* oe 2 Ape 


If the amplitudes are real-valued, as might be 
expected, Aj = A,. 


It should be noted that R(t) is always real-valued. 
This can be seen as follows: 


R(t) «= X, (t) *x,(€ + T) 
R(T) *= Xy (t) x, (t+ T)* 


Replacing t by t- rt, 


R(T)* = Xo(t- T)x,(t)® 


or 
R(-T)* = Xo(t + T)x,(t)* 
80 
R(-T)* = R(T) 
or 


R(-T) = R(T)* 


But R(-t) © R(T), as will be shown in subsection 
4; so R(T) is real. 


It is frequently convenient to work with the 'nor- 
malized" autocorrelation function, p(t), defined 
for a stationary process as 





Xa} (x, (t+T)-%)) 


[x,(t)- 
T) = Ole leeng — 8 — 
a [x9(t)-%5l 
Equivalently, 


PPPP PIP ELIA III INI NININININSRININO 
[x,(t)-X5] [xp (t+t)-%p] 


tT) s APPS S DDI 
ad PRONE 
It should be noted that the definition of autocor- 
relation functions is meaningful only for random 
processes; that is, if the ensemble {x,(t))} con- 
sists of a single nonrandom function of time (and 
is therefore perfectly predictable), R(t), if it 
exists, will not in general have any meaningful 
physical interpretation. Also, some of the proper- 
ties of R(t), which will be discussed in subsection 
4, are lost, and the usefulness of the function 
becomes questionable. 
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4. PROPERTIES OF AUTOCORRELATION 
FUNCTIONS 

The following useful properties of autocorrelation 
functions are listed to provide some insight tinge 
the expected behavior of these functions. 


Property 1. 

(V-20) p(0) = 1 
and 

(V-21) R(O) = |x,(t) |? 


(V-20) is readily seen from 


p(T) Tx,- X12 
Therefore, 
(Xy ~ Xp) (Xp - G)* 
e(0) a ara e | 
| *e ~ Xo| 
Since R(t) = X,(t)*x,(t +t), R(O) = |x,(t)|?, 


and (V-21) is established. 


Property 2. 


(V-22) R(O) > |R(t)| 
and 
(V-23) p(0) > |p()| 


(V-22) can be shown in the following way: 


[x_(tytxg(t+ t)]? = (xp (t)tx,(t + 1)) 
[X,(t)*tx, (t+ T)*]> 0 


that is, 
Xg(t)Xy(t)*t Xo(t)x_(t+ T)* + x (t+ T)x,(t)* 
+ X,(t+ T)x,(t+T)*2>0 
Averaging, 
R(O) t R(T) t R(T) + R(O) 2 O 
2R(0) t 2R(t) > O 
R(O) 2 FR(T) 
R(O) 2 |R(t)| 
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(V-23) can be seen by noting that the defining 
equation for p(t) can be written as 


R(t) - |X_|? 


e(t) = ————_ 
R(0) - |*,1? 


Since R(0) 2 +R(t), ¢ p(t) < 1. Butfrom(V-22), 
0(0) = 1 . So 


p(0) > + p(t) or |p(t)| 


Property 3. If there are no periodic components 
present in X9(t), 
V-24 li — 
te raw R(t) = 1%I? 
and 
lim 
(V-25) oa: Coe ec 


R(@) can be thought of as a measure of the aver- 
age power of x,(t) due to the presence of any 
dc components. 


Property 4. R(t) is an even function of t; that is, 
R(t) = R(-T) This is seen from 


e bd t 
cv.26) J RET) = Hy(EOHg(t #1) 
R(-T) = Xg(t)*x,(t - 7) 


Replacing t with t+T, 


R(-T) « X_(t + T)*Xx_(C) » R(T) 


Property 5. If p(t) = 0 for t 2 %, then 


To. < cos 
o( 3°) ni 


for integral n> 0, 


Property 6. If R(t) iscontinuous at the origin, 
it is continuous for all t. 


5. EXAMPLES OF THEORETICALLY DERIVED 
AUTOCORRELATION FUNCTIONS 

Autocorrelation functions of stationary random 
processes can be calculated by means of ensemble 
averages or time averages. Examples are given 
of both methods. Also, an example is given for 
the theoretical case of a purely random process. 


AUTOCORRELATION FUNCTIONS BY TIME 
AVERAGING 


EXAMPLE 1. Consider the ensemble of functions 


Xg(t) = sin(wt+ 6) where 6 is a purely random 
phase angle. This ensemble might be thought 
of as a representative set of functions which might 
be fed into a servo system over a period of time. 
All inputs would have the same frequency but would 
differ in phase. 


If 6 is a purely random variable, {x,(t)) isa 
stationary random process. So the autocorrelation 
function for the ensemble can be found by time 
averaging, that is, 


R(t) = Xg (t)*Xy(t +t) = Lim si fr sin(wt + 6)sin 


(wt + wt + 6)dt 


ee ae : 
ae ig (Oset cos 


lia 
T~@ 
(Qut+ wt + 20)}dt 


3 


aT 


sin(-2 wT + wt + 2) 
, 4w 

sin(+2wTe wt + 26) 
: 4 


- lim k COs WT 
T™7-@ 


COs WT 





R(t) = 


It should be noted that all information about phase 
is lost in the autocorrelation function although it 
retains the periodicity of x,(t) . It will be true 
in general that wherever x,(t) has periodic 
components, the periodicities will be retained by 
the autocorrelation function. (See figure V-20.) 
EXAMPLE 2. Let x,(t) = 2 A, e! (#st*) 
where the A, are real amplitudes, 9 is a random 
phase angle, and the » are real frequencies. 
This ensemble will be recognized as the Fourier 
series expansions of a given set of functions. The 
expansions differ only in phase. Then 


ED T 
R(t) = X,(t)*x,(t ¢ T) BF pair J, ce 


A, e “ItO) FY Ae Jeter t 
k je-@ 


Rewriting, 


@ 
R(t) « dim 1 $§ 


$ Stern) ag 
oT ke-@ |a2-@ 


foyr p* e 
AAjen TS 


There are two cases: w, 4 w, and uw , 4, 


For W, FW), 
L 2sin [ (w,-,) T) . 
2T 1(W)-W,) 


lim ae phetterenlat = Jim 0 


T 


Ces? 
Pe} 


«@ rhe 
om 
==. = ED 
qe 


es ee ee ee ee ee ee ee ee ee 


cP 


oT 
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Xo, (t) = sin(wt+6,) 


Xq 4(t) e Sin(wt+ 6.) 


R(T) 


| = 


R(T) = + 08 wt 


Figure V-20. Random Process x,(t) = sin(wt +0) and Its Autocorrelation Function 


For W, = Wp, 


T it@,-% Jat e oe Ce : 

lim J se “s'dt tim Tee ldt l 

Then, R(t) reduces to the single summation 
R(T) « Z A, eborr 


It can be noted that the periodicities of *,(t) are 
preserved, and all phase relations are lost. 


EXAMPLE 3. Consider the ensemble of functions 
Xy(t) = ef(t' +8) where 6 is a purely random 
variable. This set of functions is of questionable 


value for practical application although it serves 


to illustrate that autocorrelation functions are not 
necessarily continuous. Also, it illustrates that 
a given autocorrelation function does not determine 
uniquely a corresponding random process. This 
can be seen by comparing this example with ex- 
ample 7 in this section. The processes in the 
two examples are different although the normalized 
autocorrelation functions obtained are the same. 


For the present example, 


R(t) = Lim Bist en I(t ror ed [it err? +6) at 
T-e 2T-¢r 


T: 
1 ,sr®st .25et 
- iia or ° i, e@ dt 
- lim J” sin 2tT 
tT-e 2T tT 
For t # 0, R(t) = 0 since 
lim sin 2tT -0 
‘- T 


For t= 0, R(t) = 1 since 


ld, sin ast | 
jim R(T) = ° jin oT aim ora 
e 1 s 
te ote? 
Summarizing, 


1 for te Q 
The normalized autocorrelation function, p(T) , 
is the same as R&(t) since |X,| = 0 
While *,(t) cannot be graphed as a real-valued 


function, it is a linear combination of trigono- 
metric functions; that is, 


‘ for t7 0 
R(T) « 


X_(t) = cos(t?+ 6)+ J sin(t?+ 6) 
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The graph of cos(t*+ 6) is shown in figure V-21 
together with the graph of R(t). 





A = cos(t?+6,) 







B = cos(t?+ 8.) 





T —_ 2 


R(t) = O for tT4#0 
R(t) = 1 for t#0 


Figure V-21. Time Series and Autocorrelation 
Function of x,(t) © eJ(#**9) 


AUTOCORRELATION FUNCTIONS BY ENSEMBLE 
AVERAGING 


EXAMPLE 4. The autocorrelation function for the 
ensemble x,(t) = sin(wt+6) will now be de- 
termined by averaging over the ensemble. Let 6 


be a purely random variable on the interval (0, 2). 


Let y(t) be the functional value of arepresentative 
member of the ensemble at time t, and let z(t) 

be the functional value of the same member of the 
ensemble at time t+t. Then 


R(T) = RA CESK CES RY = FZ 
© [- fy 2f,(y, 2 1) dy dz 


where f2(y,z; 1) is the second probability density 
function of the stationary process {x,(t)} 


Recalling the Ensemble Average theorem, let 


u(6@) = y2 


since, for a given t and t, u can be regarded as a 
function of the single variable 6. 


Then 
R(T) = yz = u(o) 


an 
. J, Xg(t)x_(t +t) d (0)d0 


where ¢ (0) is the probability density function of 9. 
Since 6 is a purely random variable, its values 
are all equally likely over the interval (0, 2m) . 
oie ~ (6) is the constant function shown in figure 
V-22. 


y-‘ 


$(6) 1 
2X 


0 2 Q———e 
Figure V-22.Uniform Probability Density Function 


So 


R(t) = f° sin(ut + 6)sin(ut + wt + fs] do 


i, 
« ~ f,"3[cos(ur)- cos: Qwt + 20+ ot) dé 


an 
~ d [2x 008 gr SRO Be 
4n 2 0 


=! cos wt 
2 


By comparison with example 1, it is seen that the 
two results are identical, as they should be, since 
the random process is stationary. The graph of 
R(t) is shown in figure V-20. 


It might be noted that if 9 were not purely random , 
but were distributed in a biased manner, the pro- 
cess (x,(t)} would not necessarily be stationary. 
For example, suppose the distribution to be the 
so-called "normal" distribution: 


8 
$(9) = arid e208 


where -"<6<+® and where co is the standard 

deviation. Then the method of ensemble aver- 

aging gives 

° 20° 

u(9) -z cos wt = € 
2 2 





COS( Qt + WT) 


which is different from the time average. For 
such a distribution of 9, the ensemble, {x,(t))} , 
is not a stationary random process. 


EXAMPLE 5. Consider the ensemble of functions 
x,(t) , where a representative member is shown 
in figure V-23. 
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Figure V-23. Random Square Wave 


To describe the ensemble precisely, let 


X(t) * a, 


—— 
— 


— 


ee en ee ee ee i it 


~~ 


— 


ae 


oneal eae ee 








_ 


—_———_._ _ 
emigre By gute 
——a— 


= — = 


wap eed bed ed ed edd eed OL 


aperer 


ne, 
leueen) 


where 
neO<t<nel1+8 


ne OQ, 1, t 2°: 


and where @, can take the value 0 or 1 with equal 
likelihood, and 6 is a purely random variable on 
the interval 0 to1. Since 6 is purely random, 
and since an arbitrary shift in the origin of time 
would be equivalent to a new choice of 6, the 
the ensemble is seen to be a stationary random 
process. 


To obtain the autocorrelation function by means of 
the ensemble average, it is necessary to compute 
the second probability density function. Since 
the functional values of x.(t) are discrete, the 
second probability density function is actually a 
probability, and the ensemble average integral 
reduces to its discrete analog, 


R(T) s X, (tyX(t +t) © 3 KyXyf5(X4,Xy; T) 


jel is} 


To compute the second probability function, let 
X, = X,(t), X, = x,(t + t),and consider two cases: 


Case lI. |t| > 1 For |t|>1, tandt+t donot 
lie in the same unit interval; so x, is independent 


£4(X,.Xq tT) = £5(x,)£, (49) 


where 


4+ forx=0 or x= 1 
0 for all other values of x 


SO £,(x,, Xq 7) = (1/2)(1/2) = 4 for the 
following combinations: 
(1) x, = 
(2) XxX, * 
(3) Xx, = 
(4) Xx, = 


» Xo 
Xo ° 


Xo ® 


_~ Oo = © 
—=_ =—_= OO © 


) Xo ” 
and f.,(x,, x,; 1) = 0 for all other values of x. 


Case Il. |1| < 1. The probability p(t) thatt and 
t+t lie in the same unit interval is 1 - |1| . 
This is shown as follows: Consider the more 
general cases where t lies inthe interval (0, /) . 


i 
0 t tT L let 
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Then for 0<1<1l, if t+t algo lies in the interval 
(0, L), it must lie in the interval (t, 1), the 
length of which is 1 -t. Since the point t+ T. 
can lie anywhere in the range (t, 1+t), whose 
length is 1, the probability, p(t)", that t and 
t+t both lie in the same interval, (0, 2), is 
(l-t)/L . For -1<7t<0, the probability is, 
by a similar argument, (/+1)/l. Sofor It| < 2, 
P(t) = (L- ae In particular, if 1 = 1, 
p(t) = (1-]t]). If tand t+tT are both in the 
same interval, the pairs of values x, = 0, x, = 0 
and x, * 1, X, = 1 occur with equal likelihood. 
The probability 1- p(t) thatt and t+t do not 
lie in the same unit interval is |*/. In this case, 
any one of the four possible pairs of values *; = 0. 
X,2° 0; x, 20, x28 1 xX, 2 1 xe OF Xe 1 

xX, * 1 occurs with equal likelihood. 


To obtain the second probability function for Case 
II, consider the following argument: The proba- 
bility that x, = x, +0 is equal to the probability 
that x, + x, = 0 if t and t-+t are in the same 
unit interval, plus the probability that x, = x, = 0 
if t and t+ 7 are not in the same interval. The 
first of the two probabilities is the joint probabil- 
ity that t and t+7 are in the same interval and 
that the common functional value is zero. This is 
P(t)(1/2) since 0 and 1 are equally likely. The 
second of the two probabilities is (1- p(t)) (1/4) 
since x, = 0, x, = 0 is one of four equally likely 


possibilities. The same argument holds for 
X,°X 5 1. 


For x, = 1 and x, = 0 orforx, = 0 and x, = 1, 
it is necessary that t and t+ Tt do not lie in the 
same interval, and the probability that x, -0, 
X3*° 1 or xX, 2 1, %2* 0 is (1/4)(1- p(t)]). 


Summarizing, 


4 p(t) +4[1-p(t)) for x," x30 
or X,* X32 1 
4(1-p(t)] for x,=0, x3°1 
Or X,;2 1, X3=0 


f£9(X1,X%q, T) = 


where P(t) = 1- |t|. 
Using equation (V-26) with n= 2, 


R(t) = 2 (0-0 40-1 1-0¢ 1-1) ae for |t|>1 


and 
Rew) = [2 CU=L tee bel] 0-0 + tel |r] 
(0O-1¢1-0) for |t]| <1 
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The graph of R(t) is shown in figure V-24. 
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Figure V-24. Autocorrelation Function 


EXAMPLE 6. Consider an automatically tracking 
radar system which must track all aircraft travel- 
ing within a hemisphere of radius ten miles. As a 
first approximation, the angular velocity of an 

approaching airplane can be treated as constant 

through extended intervals, with abrupt changes 

from one value to another, independent of the 

previous value. The angular displacement about 
the tracking system would then vary as shown in 
figure V-25. 


a(t 





Angular 
Di spl acament 


t—e 
Figure V-25. Plot of Angular Displacement 


The changes in angular velocity might correspond 
to the maneuvers of the aircraft. To analyze the 
angular velocity, it is necessary to have the deriv- 
ative of g(t) or ¢(t). Figure V-26 shows 
¢(t) as one member, x, (t) , of a random pro- 
cess, X(t) . 
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Figure V-26. Random Angular Velocity Square Wave 


The autocorrelation function for this random 
process can be found by considering the ensemble 
of functions 


x(t) = a, (6) 






where the a,(6)’s are constants (as shown in 
figure V-26) over each interval 


tn(8) St < ty, 1(8) 


where n-0,11,+2,.... 6 is a purely random 
variable, and to each 6 corresponds one member. 
The a,’s are independent random variables having 
the same density function for each 9, that is, for 
each member ofthe ensemble. The interval lengths 
are l, = ta,,;- ty, , and they are also in 

random variables having the same probability 
density function, H(t), for each member. 


To determine the autocorrelation function, it is 
necessary to know the probability, Q(t) , that 
t and t+t Hein the same defining interval . 
Once Q(t) is known, it will be shown that 
R(t) Can be expressed as 


R(T) = Xo(t)x,(t+ tT) = a2Q(1) “a (1- Q(1)) 


To determine a? and = it is necessary to assign 
a second probability density function to the a,’s. 
Q(t) can be found in the following way: Let P, 
be the probability that t is in an interval the 
length of which is between / and l+dl. Let 
p, be the probability that this interval also in- 
cludes t++t. Then p,p, is the probability that 
both t and t+t He in an interval whose length 
is between | andl:dl. Then Qt) = 2 p,p,, 
where the sum is taken over intervals of all 
lengths. 


The probability, p,, that an arbitrary point, 
t, lies in an interval whose length is between 
l and 1l+dl is found as follows: Consider a 
long section of the t axis containing, say, K 
intervals. The total number of intervals in this 
section with lengths between 1 and l+dl is 
KH(l)dl. The aggregate length of these in- 
tervals is LKH ( Lydl , and the total length of the 


section is KI LH(L)dl. Then Dp, is equal to that 


fraction of the section filled with intervals whose 
lengths are between 1 and /+ dl. 


poe aoe 
. Ki tH( 1) dl 


where / , the average interval length, is 


iu@al 


The probability, p, , that an arbitrary interval 
of length, : , containing t alsocontains t+t 
is (l-|t/)/l for || <2 by the argument of the 
preceding example. 


LY 


LJ we FCS LS Od Cd OS LD Lo we 


Het it et it JtSWI WJ 


LHC 1 
P,P, = Se (1- aa ow (l- |] HCL) dL 


Then, as a limit, 
1 -« 
Q(t) » i {, (L- | t))H(L)dl 


It is now possible to compute R(t) if H(t) is 
known. 


For a given member of the ensemble, 


a if t and t+ lie in the same 
interval 

a,a,,, if t and t+t lie in dif- 
ferent intervals 


X, (t) X, (t+T) s 


Averaging over the ensemble, 
R(t) = Xp(Oig(Ee *) © a2 or Mann 
Since a, is independent of 4,,,. 


Since R(t) can have the value a? with proba- 
bility Q(t) and the value*4~ with probability 
[1- Q(t). 


R(t) = a,? Q(T) Pas a (1- Q(1)) 


Some special cases of interest can now be con- 
sidered. 


Case A. Consider the ensemble of functions de- 


scribed in example 5. In this example, all lengths 
i were unity. So the density function must be 


0 for l;7f0 
H(l) «= 
o for l= 1 


Since the delta function, 6x), is defined as 


1. &(x) = O for x#0 


2. f°" 5¢x) dx = | 
and since 4H(!), being a probability density , 
satisfies fH(1)d(2) «= 1, H(l) = &(l- 1), then 
ye dy (l- |t]ynqyadl 
Q(t) +1, ¢ [t])HC2) 


“$i, 0- It])8(2- 1ydu 
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To evaluate Q(t) , it is useful to recall some 
of the properties of the &-function. For x, > x, 
and arbitrary f(x), 


f(x,) for x,<x,<X, 


z 
2 
I f(x) 5(x-x,)dx= $f(x,) for x,= X, Or X,* X, 


0 for x,> X, or x, < X, 
So 
1-|t| for |t|<1 
TQ(t) = CE (1-[t]) = 0 for t= 1 
0 for |t|>1 
or 


_ 1- jt) for {tT} <1 
LQ(T) = Ir a 
0 for |t{>1 


Since 7 is the average length, and all 1's have 
unit length, |= 1. Then 


aad anc 
a2 (1-|tl) +a, (ltl) for |t]<1 


mane 
a, 


R(t) = 
for |t|>1 


Since, in this example, the a,'s take on the values 
zero and one with equal likelihood, the average 
value “a, must be 1/2. Also a,’ is either zero or 
one, 80 a,*is 1/2. Then ane 1/2 and ree V/ 4; 
and 


4 (l- [tly + dtl = $- dit] for |t}<1 
R(t) = 
4 for |th21 


It can be seen that this result is the same as that 
obtained in example 5. 


Case B. Consider the case where the times t, 
have the so-called "Poisson" distribution of ran- 
domly placed points on a line. Then it can be 
shown* that the interval lengths, /,, have the 
density function H(l) = Be"4' where § is the 
average number of points per unit length of time. 


*‘Theory of Servomechanisms,’ by H.M. James, 
N.B. Nichols, and R.S. Phillips, eds., M.I.T. 
Radiation Laboratory Series No. 25, McGraw- 
Hill Book Co., New York, 1947, p. 302. 
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Then 
Q(t) -+/ (L- |tl)H(L) dl 


“ff c- |t])pen44a1 


But 
l 
B = 1 
So 
Q(t) « pay de [t]yenF!at 
Integrating, 
Q(t) = ps eAldi-|af” en4'd | 
iv] 71 
. pa[aegll (Bl l= og (orale 
or 
Q(T) s e- Alri 
So 


R(t) = a2 ev 4lrl oS (1- ev AIP) 


It is interesting to note that if R(t) is put into 
the alternate form 


R(t) = oA iri( aig?) << 


it becomes apparent that property (V-22) is vi- 
olated if ~;?,°32 . However, a? 2 “@", as can 
be seen from the following argument: 


Let P(a) be the first probability density function 
of a. Then 


~e*. (f aP(a) da) ? 
and 


“aa = fa? P(a)da 


The second expression can be seen from the en- 
semble average theorem. Stating the theorem 
in another way, if 


“a= faP(a)da 
and 


x= X(8) 


then 
“¥(ayy es J x(a) P(a) da 


In particular, if x(a) = a? , then 
“a? « fa*P(a) da 


That a2 >“X" can be seen by recalling the Cauchy- 
Schwartz inequality which states that if f(t) and 
g(t) are real functions, then 


S(t(ty)27dat fle(ty) 4¥dt > (f£(t) g(t) dt) ? 


Let f(a) = avP(a) and g(a) = /P (a) . Since 
fPca)da = 1, by simple substitution it follows 
that a? > “a” 

Consider the case where the density of the 4's, 
P (a) , is normal 


or 


-4(#:2)° 





l 
i van. 


where m ando are the mean and standard de- 
viation of the density, respectively. Then 


rz 


= m2 


and 
SPLNe 
a2 e p47 +o2 


Then 


R(t) « m2+ a2e74 Ir 


The graph of R(t) is shown in figure V-27. 


m2, o2 a 





Figure V-27. Autocorrelation Function 


Case C. Asa special case of B, let Q(t) 
- eAlvl and x,(t) = a, - +E or -E alternately, 


or 
¢ BE, t,.,<ts t, 
a, s 
- E, t,< t< re 


_ 
rn a » 


—_—_ 


2 di 


a ee 


Lt 


ee Geren Gale 


bos es ed a tl) cd Gd ecm GE CY Ge Ge eS ee Gy 


where 


t, = ¢, (6) 
ne 0, <1, + 2, eon 
This function is shown in figure V-28. 


Q(t) = en Al7l 
R(t) © ad emAl el ME? (1- er Alel) 





—I (oor 
} ' \ ' t 
' +E t f 
1 
| | 
it, it, it, it aits It. e tee 
' t -E i t 
; ‘ | ) | " 
' \ i an, i 
p=} i 


Figure V-28. Random Square Wave 


Since a, is +E asoftenasitis -&, 8-0; 
also, a7. £2 in every cage; so 


a] ee? 


Then 
R(t) » £2 en Alri 


The graph of this function is shown in figure V-20. 


R(T) 
E2 


t~~se 


Figure V-29. Autocorrelation Function 


Case D. Consider the case where the lengths, 
Lt, » are purely random on a given interval of 
length, K ; that is, 2 can have any value between 
zero and K with equal likelihood. Then 


1, osisk 
H(t) o ¢ K 
0, 1>K 


Also, the average value 7 is (1/2)k . 8othe 
equation . 
Q(t) © Ll” (L- | H(ryaL 
lL ir| 
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reduces to : 
2, for [tl)d2 for |t] < kK 
Q(T) = 
0 for |t| > K 
Integrating, 
3 (K- |t])? for |t| < K 
Q(T) » 
0 for |t]/ > K 


The graph of Q(t) is shown in figure V-30. 


Q(T) 











-K +K 


T ag 


Figure V-30. Probability Density Function 


Then 
R(t) = a? Q(t) oS" (1- Q(t) 
For |t| < K, 
R(t) « a? (K- [al)2ay ee" [t- Zs (K- ist)? 
0 oa OF CK = [x12 0°? (KL t]-1 139) 
. Pe (Cat --a2)) 238-4?) ax | 4 +a? K2) 


For |t/>K, 


R(t) = “A 


A graph R(t) is shown in figure V-31. 





-K +K 


T ——o 


Figure V-31, Autocorrelation Function 


MN ai. “x*, R(t) is constant. It is interesting 
to note that the basic form of R(t) (parabolic for 
|t] < K and constant for |t| 2 K) is independent 
of the distribution of the a,'s. 
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EXAMPLE 7. Consider the ensemble 
x,(t) = a, a, 5 (t- t,) 


where the distributions of the a,’s andt,’s are, 
respectively, the same from member to member. 
The purely random variable © determines each 
member x,(t) . This process can be interpreted 
as a sequence of impulses distributed in time. 


For this ensemble the autocorrelation function 
has a Fourier transform which is constant. This 
implies that the autocorrelation function itself 
is a delta function, the normalized form of which 
is 


0, t70 
p(t) = 
1, t=0 


By comparison with example $3, it is seen that 
the normalized functions are equal, indicating 
the lack of uniqueness in autocorrelation functions. 


6. METHOD OF COMPUTING FUNCTIONS 
FROM EMPIRICAL DATA 

To compute the autocorrelation function for a 
stationary random process obtained from ex- 
perimental data, it is usually easier to compute 
a time average than an ensemble average. Since 
many processes of interest are stationary, a 
method of computing autocorrelation functions 
will be given only for the case of stationary pro- 
cesses. The procedure is to compute a time aver- 
age from a given set of data. The time average 
can be computed by use of the formula 


N 
z 1 
R(m) 228, Nel avo Xn Xnee 


(V-27) 
which is the general time average formula for a 
discrete set of data. The data are assumed to 
constitute a discrete time record on 0 <t<T, 
for indefinitely large T. There are N + 1 time 
values t, at which x, - x(t,) are recorded. 
The t,’s are ordered in increasing magnitude: 
O+ t, <t,<...t,=T. Atypical time record 
is shown in figure V-32. 





Figure V-32. Time Record of Niscrete Data 


V-32 


Then for each positive integer m , R(m) is defined 
by equation (V-27). It is clear that equation 
(V-27) is a direct analogue of R(t) as defined 
by the integral formula, and that R(m) has prop- 
erties analogous to R(t). 


If the time record x(t) is not discrete, it is 
possible to consider it as such by subdividing the 
interval (0, T) into N equal intervals, each of 
fixed length 4, and using only the values x(t,) 
= x(n) where n= 0,1,...,andN = T/A. 4 should 
be so small that x(t) does not change signifi- 
cantly within any interval 4. 


Since the direct use of equation (V-27) requires 
an indefinitely long time record, and since 
all records of experimental data are necessarily 
of finite length, an approximate form of equation 
(V-27) must be used. Equation (V-27) can be 
approximated by 


1 Neo 


(V-28) RU) ® aR nto Ma Yate 


where m is a nonnegative integer, and N + 1 in 
this case is fixed and is the number of values 
x, in the time record. Since the number of terms 
in the sum is(N+1)-m, and since as m increases, 
the number of terms in the sum decreases, it is 
clear that (V-28) loses reliability for large ms. 
The final curve R(t) versus t canbe found by 
plotting R(t2) versus ta where te is propor- 
tional to m. It is found that if T>>+t,,, , where 
T.,, Is the t corresponding to the largest a 
chosen, equation (V-28) is useful for most prac- 
tical applications. 


For clarity, a tabulation is given here of the step 
by step procedure which can be used in computing 
the autocorrelation function for a stationary ran- 
dom process from a time record of experimental 
data. The situation considered is that for a 
record which is continuous intime. This is the 
type of record which will actually be obtained 
from radar azimuth and elevation angle data, 
radar range data, radar range rate data, etc. 
In practice, the computations involved are much 
too tedious to be done by hand, and computers or 
autocorrelators are used for all the numerical 
work. However, the process used is similar 
to that described here. 


Step 1. Study the particular time record, x (t), 





and choose a small increment of time 4 such that 
x(t) does not change appreciably within this 
interval. 


Step 2. Divide the total length of the record, T , 
into N equal time intervals, each of length A. 
Lett, - n4, where n = 0,1,..., andlet N= T/A 
be the division points. 


Step 3. Tabulate the set of values x, - x(t,) for 
every n. 


Step 4. Square every x(t,) and sum up all the 
squared values, dividing by N + 1 to obtain the 
point R(0). 


Step 5. Multiply every value x(t,) by its next 
adjacent value x(t,, ,) and sum up the products 
from n=0 ton=N- 1. Dividing this result 
by N gives the point R(1). 


Step 6. By continuing this process for all values 
of m of multiplying x(t,) by x(t,,,) and then 
summing and dividing by the number of terms in 
the sum, M valuesof R(m) are obtained. The 
number of points M to take canbe determined by 
noticing the behavior of the points R(m) as m 
increases. ,If R(m) begins to approach a constant 
value x(t) , the process can be stopped im- 
mediately. If R(m) seems to be changing har - 
monically, the process can be stopped when the 
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Step 7. Multiplying 4 by each m, and letting 
T° m4, R(t) Can be plotted against t,. 
Step 8. o(t,), the normalized version of the 
autocorrelation function, can be plotted against 
Tt by using the relationship 


(t) « RG) = x(ty 

P R(0) - x(t) 

This is the form which is usually most convenient 
to analyze. 


Typical examples of autocorrelation functions 
which were computed numerically from a time 
record of data are shown in figures V-33 and 
V-34. Figure V-33 is an example of a time record 
containing subtle periodicities, which become 
strikingly apparent in the autocorrelation function. 
Figure V-34 is an example of a time record show- 
ing very little correlation in time; so the auto- 
correlation function is approximately zero for 
tT > 0.1 second. 


(b) CROSS CORRELATION FUNCTIONS 


A cross correlation function, R,,(t) , is a mea- 
sure of the correlation between a function x(t) at 
time t, and another function y(t) at time t+ in 
the future. The function is defined mathemati- 
cally as 





period is determined. (V-29) Riy(t) © y*(tyx(t? t) 
+) 10 15 20 25 30 35 
35 40 45 SO 55 60 65 t(sec)> 70 


(a) Tracking Error Record in Seconds 


2.0 


1.54 


1.0 


1 2 3 4 5 6 7 8 9 10 il 12 13 14 T(sec)> 
R(T) 
(b) Autocorrelation Function of Tracking Error Record 


Figure V-33. 
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Mils 


where the asterisk denotes complex conjugate and 
the bar denotes time average. Similarly a ''con- 








jugate' function may be defined as 


(V-30) 


These functions are not equivalent. 


Ry (t) = x*(t)y(te 1) 


they are related by the equation 


(V-31) 


R¥x(-T) s R, y(T) 


Fractional Modulation 


T(sec)—= 
(b) Autocorrelation Function Record of Radar Fading 


Figure V-34, 


However , 


This may be demonstrated as follows: 


Take the complex conjugate of (V-30), 


V-34 


Rox(t) = x(t)y*(€+ T) 


Let t+te u,. Then 


R¥ x(t) © x(U- T)y*(u) 


Replacing t by -t, and u by ¢, 


R$x(-T) © x(t+ t)y*(t) 
or 
Ryx(-T) © ye(t)x(te t) © RLY (t) 


It should be noted that whereas the autocorrelation 
function is an even function, the cross correla- 
tion function is not. This is apparent from the 
above discussion. 


Another useful property of the cross correlation 
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(VI-40) at as 


a+ Bx, #0 for x?a 


(VI-41) oa, ia Bx, = 0 for x<-a 


where A=1/r and B= (k,k,)/7 . If the substitution 
y = (dx/dt) is made in (VI-39) and this relation divided 
through by y, it may be written in the form of (VI-42). 


(VI-42) 2 meA for -a<x<a 


That is, for values of x between a and -a, the tra- 
jectories in the phase plane will have a constant slope 
of magnitude -A. Equations (VI-40) and (VI-41) are 
of the same form as equation (VI-21) and result in 
equations similar to equation (VI-23), or 


(VI-43) a . {#15 *4) for x>a 
| 


Y} 


(VI-44) i ° se wa’ *a 2a for x<-a 


The latter three equations provide the necessary in- 
formation for the drawing of the isoclines in the phase 
plane. 





Figure VI-35. Hysteresis Curve 


The trajectory shown in figure VI-33 was drawn with 
the aid of these isoclines. As indicated by this figure, 
the presence of threshold in the feedback path of a 
position servomechanism may cause a steady state 
error equal in magnitude to the threshold value. When 
the method used with small discontinuities was applied 
to this problem, the possibility of a steady state value 
other than zero was not apparent, since that method 
approximated the non-linear transfer characteristic 
by a straight line. 


LIMITING, When the quantity fed back in figure VI-33 
is limited se that values of the output exceeding 2a will 
not be fed back, three equations (V¥I-46), (VI-46), and 
(Vi-47) ave agnin needed to describe ali the pasaible 


. metions of the system. 


= as — 
—— 7 - = lemmeemmeal - a ~ — 
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(VI -48) A or +B Se Cx=0 for -a<x<a 


d?x ,dx. 
(WI-46) A ave] ——= +B it aC for x>a 
(VI-47) A ey +8 a" for x<-a 


The corresponding equations for the isoclines are: 


(VI-48) dy (eae) for -a<x<a 


omy (BE) tor we 
Isoclines i 
kN ; 
aM l] 
wt 


ie Isoclines 


Pigure VI-36. Phase Plane; Closed Leop Systen with 
Byeteresis in Feedback 
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(VI-98) ¢. {t¥) fer x<-a 


These three equations with A-B-1 and C= 10 were 
used to draw the isoclines of figure VI-34. 


HYSTERESS. Figure VI-35 illustrates the hysteresis 
curve which describes the relation between the output 
(x) aad the quantity fed back (¢); zx, and x, are the 
maximum amplitudes reached by the output, and 2s is 
the maximum range through which the output can move 
without causing eny change in the quantity fed back. 


The differential equations for the system are 


(W2-81) A Py on 83 5 c(x- a) * 0 

(VI-52) A a ti. C(x, -a) » 0 
(VI-53) A dyn dks ccxs a) = 0 
(VI-54) A i508 a, C(x, + 8) = 0 


By making the substitutions y= (dx/dt), x,=x-a, 
Xgexea and dividing the resulting equations by y , 
these become 


(VI-5S) a . Aneta) with crigin at x*=a 


J1 


B 
y+ fD 
(VI-356) Fd . (Be: 80) where D, = (x,- &) 


(VI-38) x . (fi) where Da= (x,°¢ &) 


Equations (VI-55) and (VI-57) are of the same form as 
previously discussed. Equations (VI-56) and (VI-58), 
however, are functions of x,. Therefore, no family 
of isoclines can be drawn until an initial value of x, is 
obtained. For the purpose of drawing the trajectories 
in figure VI-36, the coefficients of the equations and the 
hysteresis range were assigned the values A-Bea-1l, 
and Ce-10. 


To start the construction of the trajectory, an initial 
value of x, was chosen at point A in the figure. With 
this value of x,, equation (VI-56) provided the slopes 
of the trajectory for different values of y, which per- 
mitted drawing the trajectory from AtoB. Polnt Bis 
a distance of 2a (total hysteresis range) on the x -axis 
from A, and is the point at which the equations of slopes 
must change from (VI-56) to (VI-57). From point B to 
C the trajectory follows the slopes given by equation 
(VI-57). The value of x at point C is the x, of equation 
(VI-68) which is valid until the trajectory reaches point 
D. From point D to E equation (VI-55) provides the 
slopes of the trajectory. At point & the process is 
repeated except for the different values of x, used as 
the trajectory passes through the x-axis. 


In figure VI-36 a second starting point was taken at 
point L and the above procedure repeated: Unlike the 
other closed-loop examples, the steady state motion 
of the output is other than zero. The trajectory start- 
ing at A tends to spiral toward the origin; while that 
Starting point nearer the origin, point L, tends to 
spiral away from the origin. Both of these spirals 
are actually approaching the closed curve indicated 
by a dashed line. The significance of this closed curve 
is that the system will operate in what is termed a 
limit cycle; that is, irrespective of the initial con- 
ditions, the steady state output of the system will be 
oscillatory and of a magnitude indicated by the dashed 


line. That steady state oscillations could occur in 
(VI-57) dya . (Resi) with origin at x=-a Such a system has been shown by the methods used 
dx; ¥2 with small discontinuities. 
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function is the following: 
(V-32) VRCOY VRy (OY 2 |Rxy(t)| 


where R,(t) and R,(t) are autocorrelation func- 
tions. Equation (V-32) may be deduced from 
the inequality 





r | 
lyst, Ix(temll , 
YR,(0) VR) f ~ 
Squaring, 
lye(ty? , Ices ol? | alye(tyx(te wl, 
R, (0) R, (0) 7R,(0) RCO) 


Taking the time average (indicated by a bar) and 
rewriting the squared terms, 


Qly*(t)x(te t) | > 0 


y(t)y*(t) A X(t + T)x(t + T) 
/Ry(0) “Rx (0) 


Ry (0) Rx (0) 


Since y(t)y*(t) = R,(0), 


lelt 2] y*(t) x(t + T) > 0 
¥Ry(0) ¥ Rx (0) 
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or 
(V-33) /Rx(OY VRy(O) 2 F ly*(t)x(t+ | 
But since 

ly*(t)x(te)] « jis A filye(tyx(t + t)|dt 


and 


im f(x)|dx > ft(xydx 


(V-34) |y*(t)x(tet)|] 2 ly*(t)x(ton | © [Rgy(t) | 


Since |y*(t)x(t+t)| >0 , the * can be omitted 
in (V-33), and using (V-34) in (V-3$), 


WRy(O0)V Ry(O) 2 |y*(t)x(t+ t)| 2 [Ryy(t)| 


which is the required result. 


It should be noted that in many physical appli- 
cations, the cross correlation functions turn out 
to be approximately zero. This is fortunate since 
in such cases the complexity of the problems is 
greatly reduced. 


SECTION 4 - SPECTRAL DENSITY 


The spectral density of a function is a measure 
of the variation of the function with frequency and 
as such has application in many fields. The con- 
cept of spectral density is of particular interest in 
this chapter because it arises naturally in the 
development of theories concerned with optimum 
synthesis. Much of the mathematics used in this 
section is explained in detail in the Appendix. 


A formal definition of the spectral density is pre- 
sented in subsection (a). This is followed by a 
discussion of (b) Physical Interpretation, (c) 
Properties, (d) Examples, and (e) A Numerical 
Method of Computation. 


(a) FORMAL DEFINITION 


Consider any function, y,(t) , defined as follows: 
y(t) “Ts tseT 


0 all other values of t 


Let A,(w) be the Fourier transform of y,(t), or 


(V-35a) Ay(w) = [7yq(tyeMtdt = fy(tyen Hat 


Let G(w) be the spectral density of y(t). Then 
G(w) is defined as 


2 
(V-36) G(w) = lim * |Ap(o) | 


The spectral density of y,(t) may be computed 
directly from equation (V-36). In practical ap- 
plications, however, the limit in equation (V-36) 
is frequently difficult to find. An alternate method 
of obtaining the spectral density, which circum- 
vents this difficulty, uses a relationship between 
the autocorrelation function and the spectral 
density. This relationship is developed in sub- 
section (c), Properties. In subsection (d), Ex- 
amples, the alternate method of computing spec- 
tral densities is used exclusively. 


(b) PHYSICAL INTERPRETATION 


Assume that y(t) is a time varying voltage across 
a unit resistance. It is shown below that G(w) dw 
is proportional to the average power dissipated in 
the resistance in the frequency interval (u, 
w+ dw). 


V-35 
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Since power is the ratio of the voltage squared 
to the resistance, the time average of the power is 


a7t) e 1 sty 

y2(ty o lim oe Jy *(tydt 
From (V-35) 

y2(t) « lim 2. f_ y_(tydt 
But, by the Parseval theorem, 


S-ya(tyat ° ob fo] Ap (w) | 2d 


sO 


: 2(t) « 1 1° a 
(V-37) y%(t) = Jim 5 5 Jl lAp(o) | Ade 
From equation (V-35a) 


Ag(-0) = f° ¥q(tyettdt = AL(w) 
Therefore, 
| Ay (wo) |? = (Aq(w)) LAS (w)) = [Aq (w)) [Ag(-)) 


The last equation shows that |A,(w)|? is an even 
function, or 


(V- 37a) | Ap(-w) | 2 © | A_(w) |? 


Since the integrand in (V-37) is an even function , 
the limits may be changed. 


Then 
a(t) e eee ee 2 
y(t) hal T 2n J | Arco) ae 
or 


2 Pe i ial 
y2(t) ran G(w) dw 


From (V-36), 


y- 2(t) « Ls” 
(V-38) y*(t) de G(w) dw 


Equation (V-38) demonstrates that since y? is the 


average power, G(w) must have the dimensions 
of average power density. Equivalently, G(w) is 
a measure of the average power dissipated in a 
resistance at frequency uw. 


(c) SPECTRAL DENSITY PROPERTIES 


Property 1. A basic property of spectral densi- 


V-36 


ties involves their relation to autocorrelation 
functions. If R(t) is the autocorrelation function 
of y(t) , and G(f) is the spectral density of 
y(t) , then G(f) and R(t) are related bya 
Fourier cosine transform pair; that is, 


G(w) = 4 i R(t) cos wt dt 
(V-39) 4 


ioe Os oe 
R(t) aa i, G(w) cos wt dw 
By consulting the definition of Fourier cosine 
transform in the Appendix, equations (A VI-4) 


and (A VI-5), it may be seen that G(w) and 2R (1) 
are a Fourier cosine transform pair. 


These relations can be demonstrated as follows: 


Let 
(V-40) C(t) mr f-Yq(tyy g(t t) dt 


where y,(t) is defined by (V-35). Then 
(V-41) dim Cp(t) = R(T) 


Let H(w) be the Fourier transform of C,(1), or 
H(w) = JC, (ted 
21s dt f eye (tyg(t + T)dt 


@ 
eo PP arf en io(terresuty (tyy (t+ tat 
-@ 
Let x= t+T. 


H(w) = dS. dx J e Jetgloty (tyy.(x)dt 


Interchanging the order of integration, 

(v-42) H(w) = 3 foot ye(tydtf e3+* yg(x)dx 
Since 

(V-43) Ag (w) = f° yq(tye"totdt 

then 

(V-46) — AY(w) © [ yq(tyetotat 
Substituting (V-43) and (V-44) into (V-42), 


(V-45) H(w) = ap Ar (io) Ag (e) . sp lArio |? 


Taking the limit of both sides of (V-45), 


re" nun ers eraser mre Cv} 
(een gues ogee  =«—— ——— 


a 
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i ~—— —————— 


———eme, 
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ee ee ee ee eee ee 
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Lim H(w) = Lim J. | Ag(w)|? 
But using (V-36), 
lim H(w) = 2 (wu) 
Then . 
G(w) = 2 lim H(w) = 2 Lim f° C,(ne"I4r de 
2 2f lim C,(t)e°I¢" dt 
From (V-41), 
G(u) = 2 f- R(t)e Io" dt 
or 
G(w) = 2s R(tT)coswtdTt- 2j i R(t)sinwtdt 


Since R(t) = R(-t) , the second integral is zero, 
and the first integral may be rewritten as 


G(w) = 4 I R(t)coswtdt 


The last equation may be thought of as the Fourier 
cosine transform of [2R (t)]. Taking the inverse 
cosine transform of 2R (*) , 


2R(T) = if G(w) COS w T dw 


or 
1 po 
2 no 


It should be noted that the definition of spectral 
density, equation (V-36), is valid for any function 
of time y(t). However, although the property 
described by equation (V-39) is also valid for any 
function of time y(t), it is meaningful only for 
random functions of time. The succeeding dis- 
cussions are directed toward the use of spectral 
density in theories that treat only stationary ran- 
dom processes, and equation (V-39) will be applied 
without further explanation. 


Property 2. 
(V-46) G(w) = G(-w) 


This can be seen by substituting (V-37a) into 
(V-36). 


Property 3. If y(t) has a non-zero mean, i.e. , 
if y(t) contains a dc term, G(wv) has a singu- 
larity at the origin. Equivalently, 
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2 
G(w) = 4nY 5(w) + G, (wv) 


where Y is themean of y(t), and G,(») is the 
spectral density of y (t)when computed relative 
to the mean. This property is corroborated in 
example 1 of Section 4d. 


Property 4. If y (t) contains any periodic terms, 
e spectral density will contain 5 -function peaks 


at each of the frequencies of the periodic terms. 
This property will also be demonstrated in ex- 
ample 1 of Section 4d. 


propery 5. For a linear system, let R(w) and 
C (w) e Fourier transforms of the input and 


output, respectively. Let Y(s) be the transfer 
function of the system where s is the Laplace 
transform variable. Then, if G.(w) and G, (w) 
are the spectral densities of c(t) and r (t), 
respectively, 


(V-47) G.(w) = |¥(jw) | 76,(w) 


The system and its inputs and outputs are shown 
in the block diagram of figure V-35. 


R C(w) 


Figure V-35. System Block Diagram 


By block diagram algebra, 
C(w) = R(w) Y(w) 
By the convolution integral theorem, 
C(t) = f- r(t-p) W(p) ap 


where W(p) is the memory function of the system. 


Let R,(t) be the autocorrelation function of the 
output. Then 


R(t) = lin J at|s* r(t- p)W(p)dp 


, r(t+T- a) Wa) dal 


Interchanging the order of integration, 
R,(t) = ix im dq W(p) jis 


[al dt r(t-p)r(t¢t- a] wa) 
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Let 
t-peu 
and 
U(T, 4p) = mf r(u) r(u+ (p+ t- q]) du 
Then 
Jia U(t, QP) = Rr(p + t- Q) 


where R, is the autocorrelation function of the 
input, r(t). So 


R(t) = f- a J dq W(P)R,(p + T- a) ¥(Q) 
Taking the Fourier transform of both sides of 
this equation, 

G.(w) = f (2K, (t)]e Ir de 


“2 J) de {7 do J) dq 0°10" B,(D +t a) 
wip) W(q) 
- 2f-dt [dp fodqe setrenea) et Sup 


e°I9 R(t + p= q)W(P)W(Q) 
Let t+p-q=»= V; 
then 
G.(w) = 2 f dvf- dp f- dre" JOV giwD e°Jua 
R, (Vv) W(D) W(q) 
This equation may be rewritten as 
G.(w) = 2 sf e° Jwv R.(v) dv freer Wip)dp 


f e°J“9 Wanda 


In the Appendix it is shown that the Fourier trans- 
form of the memory function is the transfer func- 
tion with s replaced by ju, 


G.(w) = 2 jeie R (vy dv] ¥(jw) | ? 
But, by Property 1, 
G,(w) = 2f R(vye 4% dv 
80 


G.(w) = [¥(Jo)|” G,(w) 


(d) EXAMPLES 


EXAMPLE 1. Let the Fourier expansion of the 
ensemble of functions y,(t) be 


(V-48)  yy(t) = Ao+ a [A, sin(w,t+ )) 


Then it can be shown® that the autocorrelation 
function of this ensemble(where the w,’s are fixed 
and the ¢ ’s are purely random) is given by 


a 
A 
R(t) = AZe 2, > 008 W,t 


Using equation (V-39), 

G(w) = af. Az + 3 A oad tICOSWTAT 
of ° “nei 2 . 

Expanding, 


(V-49) G(w) = 4 A? f cOoswtdTt 


5 AZ @ 
+42 our COB W,T COS WT 


By expanding equation (A VIII-5) of the Appendix , 
it can be found that 


(V-50) a coswtd te 75 (w) 


Substituting (V-50) into (V -49), 
(V-51) = G(w) = 4m A? 8(w) 
+ 2 2 A,’ S COS WT COS wT dt 


Applying the trigonometric expansion formula 


cos a cos b = + (cosas b) + cos(a- b)) 


eo 


o A 
(W-52) G(u) = 4m Ay b(w) +2 2 i 

{cos T(W, + w)dT + Scos +(u-0) 47] 
From (V-50), 


(V-53) = G(w) = 40 A? 8(u) 


1 2 Ay? (6(w, + w) +5(w,-w)) 


Equation (V-53) exemplifies properties 3 and 4. 
Note that at zero frequency a delta function peak 
appears which corresponds to the dc term, A, , 


“ply the same methods as in Section Ja), example 2. 
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in y(t). Also, delta function peaks occur at the 
discrete frequencies », , and these peaks cor- 
respond to the frequencies of the periodic com- 
ponents of y (t). 


EXAMPLE 2. In Section 325, example 6, it was 
shown that the autocorrelation function of the time 
series corresponding to the angular velocity of an 
automatically tracking radar system is given by 


(V-54) R(T) = a2 Q(t) '4[1- Q(T) 

Q(t) is the probability that t and t+ 1 liein the 
same defining interval, and the a’s correspond 
to the randomly constant values assumed by the 
angular velocity. The spectral density of this 


stationary random process can be found by apply- 
ing equation (V-39). 


G(w) = 4S cos tla” + Q(T) (af--a4))a+ 

2 af COS w T dt+ (ata) * Q(t)cos atdt 
By equation (V-50), 
(V-55) G(w) = sa Ble) 4(a2-"22) f"Q(1) cos wt dt 


In case B of example 6, Section3a5, it was demon- 
strated that if the angular velocity discontinuities 
have a Poisson distribution, then Q(t) is given by 
(V-56) q(t) = ele 


where § isthe mean density of points per unit 
time. Substituting (V-56) into (V-55), - 


G(w) = an 7875 (w) ra(az a} freer cos wtdT 


But 
f €87 cos wt dT ® Beat 
So 
“Dw 
(V-57) G(w) = renee Ne 5(w) + ao(@*-"«’) 
B2 ‘ w? 


The first term in (V-57) could have been predicted 
from property 3. The spectral density has a delta 
function peak at the origin. If the mean of the 
random process is taken to be zero (@ = 0) , 





AS ae 4 B 
V-58 » a2 
( ) ei a B2 4 w2 


A graph of this function is shown in figure V-36. 
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Figure V-36. Spectral Density of Example 2 


EXAMPLE 3. Consider the "purely" random 
process (see Section 3a 5, example 7), which has 
the autocorrelation function 


(V-59) R(t) = * 5(+) 

where K is a constant. From equation (V-39), 
G(w) = af” R(t)coswtdt 

Since R(t) = R(-T), 
G(w) = af R(t)coswtdt 

or 
“u(w) = Kf (t)cosw td t 


But, from the sifting property of the delta function 
[see (A VIII-2) of the Appendix], 


(V-60) G(w) = K[cos w(0)| = K 


A graph of this function is shown in figure V-937. 
This type of spectrum, arising from a purely 
random process, is frequently referred to as 
“white noise." 





Figure V-37. Spectral Density for a Purely 
Random Process 
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In problems concerning systems with noise inputs, 
it is often convenient to treat the noise as if it 
were derived from a purely random process. 
This assumption may be made if the noise has 
a flat spectrum which extends considerably beyond 
the cutoff frequency of the system. (High fre- 
quency components of the noise are so attenuated 
that, beyond the cutoff frequency of the system, 
their effect on the output is negligible. ) 


It is important to observe that white noise, while 
useful as an analytical test, cannot be realized 
physically. This can be seen from the physical 
interpretation of spectral density. By equation 
(V-38), y° is a measure of the average power , 
and where G (w) = K, 


yz - 1 fg d ae Oe ae . K zs 
y xaJ, (w) dw nf Kaw sz, de 


A constant spectrum (white noise) would require 
infinite average power. 


(e) NUMERICAL METHOD OF COMPUTATION 


The method of computing spectral densities used 
in subsection 4d was applied to autocorrelation 
functions expressed in analytic form. It was 
shown in Section 3a6 that autocorrelation functions 
obtained from empirical data are typically defined 
by a finite set of discrete points rather than by 


G(w) 


come 
mo FOO OS wm) &® HM © OC wm BB OD wow OO 


an analytic expression. This subsection outlines 
a procedure for computing the spectral density 
from such autocorrelation functions. 


By modifying the methods used to derive equation 

(V-39), the relation between the autocorrelation 

function and the spectral density may be extended 

to a finite set of discrete data by the equation 
M 

(V-61) G(w) = 4| 20 ae R(m)cos mw A 


4 is the duration between the times at which the 
discrete data are recorded; M isthe total number 
of points taken off the autocorrelation curve where 
tT, = MA, and t, is the total length of the auto- 
correlation record. R(m) is the value of the 
autocorrelation function at the m*" point. These 
terms are discussed and defined in greater de- 
tail in Section 3a6. 


The spectral density G(w) may be computed by 
substituting M+ 1 points into equation (V-61). 
The usefulness of the results obtained from the 
application of equation (V-61) is dependent upon 
judicious selection of 
1. The length of the autocorrelation curve. 
2. The length of the intervals, A. 
1. Equation (V-61) was derived from equation 
(V-39) which is restricted to functions described 
analytically for all time. Equation (V-61) is ap- 


Figure V-38. Spectral Density Function 
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plied to time records of finite duration, and thus 
to autocorrelation functions of finite length. The 
resolution (or minimum frequency difference that 
can be detected) is inversely proportional to Ty, 
the total length of the autocorrelation curve. 
2. To detect any periodic function of frequency f, 
it is necessary to evaluate the functicn at intervals 
equal to or less than one-half its period. There- 
fore, the highest frequency component that can 
be isolated by application of equation (V-61) is 
equal to(1/2)Acycles per second. 
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In summary, the spectral density G(w) may be 
computed from equation (V-61) as precisely as 
desired by obtaining a sufficiently long auto- 
correlation curve and by selecting 4 as small as 
necessary. 


Figure V-38 shows a typical plot of a numerically 
computed spectral density. This spectrum was 
computed from the autocorrelation function rec- 
ord shown in figure V-33 of Section 3a86. 


SECTION 5 - SYSTEM OPTIMIZATION BY THE WIENER METHOD 


This section presents a method of optimum syn- 
thesis of linear systems developed by Wiener. 
The section is divided as follows: 

(a) Introduction 

(b) Assumptions and Limitations of the Wiener 

Method 
(c) Mathematical Derivation of the Method 
(d) Discussion and Example of Results 


(a) INTRODUCTION 


The output signal of a physical system frequently 
differs from the desired system output because of 
corruption by noise. (Noise will be defined here 
as any unwanted random disturbance to a physical 
system.) It is usually impossible to eliminate 
entirely the effects of noise on a system output, 
but by judicious design, it is possible to reduce 
these effects considerably. One of the problems 
treated in this section is that of finding those 
system characteristics which will effect the best 
noise reduction. 


A second problem treated here concerns the de- 
termination of the characteristics of that system 
whose output signal most nearly approximates a 
time displacement of a message input. In a given 
physical system, it might be desired to solve 
only one of the two problems mentioned above. 
Although the succeeding discussion treats both 
problems simultaneously, the results of the 
method are applicable to either problem sepa- 
rately. 


The problems discussed above may be expressed 
more concisely with the aid of figure V-39. 


W(t) 


Figure V-39. Block Diagram of System 


In the figure above r(t) , c(t) , and W(t) are 
the input signal, the output signal, and the system 
memory function, respectively. Let 


(V-62) r(t) = f(t) + g(t) 


where f(t) is a message input and g(t) is the 
sum of all noise inputs to the system. The Wiener 
method of system optimization specifies mathe- 
matically that memory function which makes the 
output, c(t) , the "best" approximation to a trans- 
lation of the message input, f(t + o), where o 
is some real number. The error in approxima- 
tion, ¢«(t) , is defined as: 


(V-63) e(t) = f(t +o) - c(t) 


and the approximation will be assumed "best" 
when the mean square of ¢«(t) is minimum. 
As a point of interest, if ° is positive, the system 
is called a "predictor" or, sometimes, an "ex- 
trapolator!' If o is negative, the system is re- 
ferred to as an "interpolator." If 9 = 0, the 
system is called a "duplicator." 


(b) ASSUMPTIONS AND LIMITATIONS OF 
THE WIENER METHOD 


The reason for the choice of the mean square 
error criterion assumed in Section 5a is not im- 
mediately apparent. A simple explanation for 
this choice is that it permits the development 
of analytic methods for synthesizing systems 
with random inputs. For many problems, other 
criteria are certainly more suitable. However, 
methods which apply these criteria have not yet 
been developed sufficiently for practical appli- 
cation, 


A list of some additional limitations and assump- 
tions made in the development of the Wiener 
method follows: 

1. All physical systems to which this method 


V-41 
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is applied are linear. 

2. In many cases it is not possible to realize 
practically the memory function derived ana- 
lytically by the Wiener method. 

3. Both message and noise inputs are random 
and belong to stationary processes. 

4. The autocorrelation functions, cross cor- 
relation functions, and spectral densities for 
the message and noise must exist. 


(c) MATHEMATICAL DERIVATION OF THE 
WIENER METHOD 


The Wiener method will be derived as follows: 
1. An expression for mean squared error will 
be found in terms of statistical properties of a 
message and noise signal. 

2. The mean squared error is then minimized 
by use of the calculus of variations. In the 
process of minimization it will be found that 
the optimum memory functions must satisfy 
a Wiener-Hopf type integral equation. 

3. The memory function will be expressed 
in terms of the solution to the integral equation. 


R C 


Figure V-40. System Block Diagram 


Consider the system block diagram shown in fig- 
ure V-40 where R(w) and C(w) are the Fourier 
transforms of the input and output signals, re- 
spectively, and Y(w) is the transfer function with 
s replaced by jw. Let 


(V-64) r(t) = f(t) + g(t) 

where f(t) is the desired message input and 
g(t) is the total noise input (both are assumed 
stationary random). 

From figure V-40, by block diagram algebra, 
(V-65) C(w) = Y¥(w) Rw) 


The inverse Fourier transform of (V-65) is, by 
the convolution theorem of Fourier transforms, 


(V-66) c(t) = [or(t- T)W(t)dT 


where w(t), the memory function, is defined as 


(¥-67) W(t) = Df” Kye du 


Since W(t) = 0 for t= 0 (see Section A IX of 
the Appendix), 


V-42 


(V-68) Wo(t) = [or(t- T)W(T)AT 
Substituting (V-64) into (V-68), 


(V-69) c(t) « SrUt(t- tc) og(t- t)) W(t)dt 


Since it is required that c (t) be the best approxi- 
mation to f(t+o) , let the error be 


(V-70) e(t) = f(t +a) - c(t) 
Substituting (V-69) into (V-70), 


(V-71) —-e(t) © f(t+0) 


“J. [f(t- t)+e(t- tT] W(t)dt 
It was stated in the introduction to this section that 
the optimizing criterion in the Wiener method is 


minimization of the mean squared error. Equiva- 
lently, it is required that 


(v-72) [ect]? = lim 2 fF jecty| at 


2T =f 


be a minimum where the bar denotes time aver- 
age. The absolute value of the error is used to 
account for possible complex values. 


From equation (V-71), 
lect)? = e(t)e(t)® « (f(t +0)-f" (f(t- 1) 


¢ g(t- t)] W(t) dt} 
{f (tea) *- J [£(t-1) 9 9e(t-1) 9) W(t) *dt) 


where the asterisk denotes the complex conjugate. 
Expanding, 
(V-73) 
e(t)|2 © £(t+0) f(t+0)* - (too) f[£(t-7)° 
+e (t-T)*) W*(t)dt- £(t+o) *f(£(t-t) 
1B (t-t)] W(t)dt ef dt(f(t-1)° 
+g(t-t)°] We (t)J dul f(t-up +6(t-u)) W(u) 


Substituting (V-73) into (V-72), 


| E(t) |? » £(t+o)f(t+o)* 
ee 
~£(teo)*f, [£(t-t) + (t-1)) W(t) dT 


oer 





a i ee ee 
+f dtl f£(t-t) %*e(t-t)4 W(t) *f, du [ £(t-u) +g(t-u)) W(u) 
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Interchanging the order of integration, 


Je(t)|2= £( tea) £(teo)*-f, W(t) dt{ £( t+) £( tT) *) 
~foWe(t)dtL£(t +o) e(t-t)°) 


~f, W(t) dt [£(t-1) £( t+) *) 


(V-75) © sd ee eet aS 
“Sy W(t) dt[g(t- 7) f(t+0) *] 


+f At f “du wer)? w(uy{£(t=7) *f(t-u) 
+g(t-t)*f(t-u) +f( t- T) *g( t-u) 
+B( t-t)*g(t-u)) 


The notation can now be simplified by noting that 
the barred expressions represent autocorrelation 
and cross correlation functions. 


Let 
Ree(x) = £(t)*£(t+ x) 
Ree(X) = f(t) *ge(t+ x) 
(V-76) 


Ryg(X) = @(t)*a(t + x) 
Reg (X) = g(t) * f(t + x) 
where R,,-(x) and R,,(x) are the autocorrelation 
functions of the message and noise signals, re- 
spectively, and R,,(x) is the cross correlation 


of the message and noise. Note that Re,(x) 
7 Re r(X). 


Substituting (V-76) into (V-75), 
lect) |?- Re (0)-f We (t) dt Rep (+t) 
-{owe(t) dz Reg (et) -f W(t) dt Ree (o +t) 
(V-77) -[°W(t)dT RE, #7) 
‘fdtf du W(T) *W(U) {Ry ¢(T-U) *Reg (THU) 
+Ry ¢(T-U) Re (TU) } 
Rewriting (V-77), 
[e(t) |?» Re e(O)-J W* (t) [Ree +t) +Reg(o +t) ) dt 


(v.78) “J W(t) (Re (+t) Re (+) J dt 
+f dtf “du W(t) *w(u)] (Ree t-u) ¢Reg (TU) 


+R ae (TU) Re (t-u)} 


For simplicity, let 
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h(x) s Ree(X) Reg (X) 
Substituting (V-79) into (V-78), 


(V-79) as © Ree(X) Reg (X) Rg e(X) tRgg(X) 


| e¢t) |? . Re g(0)-f We(t)he +t) dT 
(V-80) : fow(tyhe (9 +1) dt 


fedrf du W(T)* W(u)P(T-u) 


In the mathematical discussion above, the re- 
lation of the error to the statistics of the message 
and noise and to the memory function of the sys- 
tem has been developed. 


The next problem is to minimize the mean squared 
error with respect to W(t). However, by study- 
ing equation (V-80), it may be seen that the usual 
method of differentiating to find an extreme value 
is not applicable here because W*(t) is not a dif - 
ferentiable function with respect to W(t) and 
because the unknown function, W(t), occurs under 
the definite integral sign. Therefore, another 
method for minimization, the calculus of varia- 
tions, will be used. This method is particularly 
applicable to the present problem since it provides 
a means of finding functions whose definite in- 
tegrals have extreme values. The general pro- 
cedure which will be used is outlined below: 


Given the integral 


a | 
(V-81) I= J Ply(x)) dx 
C0] 
determine the function y(x) which will make I a 
minimum. To do this, consider functions § which 
are neighboring toy. Let 


$(x) = y(x) + € 2(X) 


where « issome small quantity and 2(x) is an 
arbitrary continuous function of x with a con- 
tinuous derivative in the interval (x, , x,) (see 
figure V-41). 





“So 
y (x) 


x 
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Figure V-41. Possible Variations of y(x) 


V-43 
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The neighboring functions ¥(x) are substituted 
into the integral (V-81), and it is required that 
¥ coincide with y at the endpoints of the interval. 
I is then a function of «, and the requirement that 
1 be minimum is that 


dI (€) 
de 





= 0 


However, if y(x) is to be the function which 
makes I (€)a minimum, and ‘¥(x) © y(x) when 
¢= 0 , the requirement becomes 


di(e 


The mean squared error given by equation (V-80) 
can now be minimized subject to the conditions 
of equation (V-82). Let 


(V-83) W(t) = M(T) #2 (T) 


where 7 is a small real quantity and 2(t) is 
arbitrary. u(t) is the optimizing memory func- 
tion. Substituting (V-83) into (V-80), 
Je(ty|? © Reg(0)-f he +t) [MP (t)+nz* (t)] dt 
-fone (+t) (M(T) +nZ(T)) dt 

(V-84) @ @ 
+f, ats . du(M(u) #z(u) ) (M°(T) 
+1 2°(T))O(T-u) 
Differentiating (V-84) with respect to n and set- 
ting the expression equal to zero, 

f,he +T)Z*(T)dT + fh (O +t) Z(T)dt 


(V-85) “Io dtj dud (t-u) (2(u)M*(T) 


#M(U)Z*(T) + Zn Z(U)Z*(T))} 
» 0 


Rewriting (V-85) with n = 0 to satisfy equation 
(V-84), 
(V-86) 


vz (t)dt{h@G +t)-JO(t-uyMCu) du) 


+f 2(t)h* (0 ¢t) dt - Soar f dud (Tou) Z(U)M*(T)“0 


Equation (V-86) may be placed in a more suitable 
form by recalling some of the properties of cor- 
relation functions: 
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Re e(X) © Re e(-X) 


Re (x) = RL, (+X) 
(V-87) éé &é 
RE,(X) = Ree (7X) 


Re e(*) = Reg (-X) 


If the relationships of equation (V-87) are sub- 
stituted into equation (V-79), it is found that 


(V-88 ) f° (-x) © A(X) 


The last integral in equation (V-86) can be written 
as 


frat Jdu $(T-u) zZ(u)Me(T) = Svat sau p(u-T) 
2(T)M*(u) 


by replacing t by u and u by t. Applying (V-88), 
this integral becomes 


(V-89) fratf, due (teu) z(uyMe(t) = So 2(t)dt 


(fy Me (u) 6° (r- udu} 


Equation (V-86) can be written in a more sym- 
metric form by using the relationship of equation 
(V-89): 
(V-90) 

J, 2* (x) dt(h@ +t) > fod (t-u)M(u) du) 


ef2(t)dt{h* (ot) - fo o* (t-u)Me (udu) = 0 
By defining 
Us J 2 (tydt(h(o + T) “f(t u)M(u) du} 


it may be noticed that equation (V-90) has the 
form 


(V-91) U+U* = 0 

To satisfy equation (V-91), U must be pure im- 
aginary. But since z(t) is completely arbitrary, 
u is arbitrary and is therefore not restricted to 
imaginary values. So it must follow that U = 0. 
Then (V-90) reduces to 


(V-92) fae (x) V(r) dt - 0 
where 
(V-93) V(t) = h(a +t)- f@ (t-u)M(u)du 


Since z(t) and therefore 2°*(t) is arbitrary, 
V(t) must equal zero for all t 2 0 if equation 
(V-92) is to be satisfied over the range of inte- 
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gration indicated; that is 


(V-94) V(t) = 0 for +120 
and from (V-93), 


(V-95) het) » S-o(t-uyM(u) du for t 20 


Since hi +t) and ¢(t-u) are functions of the 
noise and message statistics, they are "known" 
for any given problem. Therefore, if(V-95) can 
be solved for M(u), that memory function which 
minimizes the mean squared error of the system 
will have been found. Equation (V-95) is a Wiener- 
Hopf type integral equation of the first kind. It 
may be noticed that since the equation is satisfied 
only for t>0 , it cannot be solved by the custom- 
ary Fourier convolution method. 


A technique called the "factorization method, " 
which will be employed to solve this equation, is 
discussed below. 


FACTORIZATION METHOD. This method con- 
sists of finding two functions whose product is 
the Fourier transform of ¢(t), such that one of 
the functions is analytic in the upper half of the 
complex plane, and the other is analytic in the 
lower half plane. If the factorization process can 
be carried out, equation (V-95) can then be solved. 


The following properties of $(w) , the Fourier 
transform of ¢(t) , will be useful in deriving the 
factorization method: #(w) is (1) real, (2) 
greater than or equal to zero but almost always 
greater than zero, (3) almost continuous, and 
(4) zero for sufficiently large ». 


These properties can be justified in the following 


way: 
1. 4(w) is real. From (V-88), 


$*(-x) = $(X) 
Also, 
$(w) = f-o(xye $e dx 
Then 
*(w) « S-oe(xyeto* dx = So(-x) 0! dx 
Replacing x by -x, 
$+(u) = fd(xye IF dx = (a) 
So 4(w) is real. 


2. ¢(w) is always greater than or equal to 
zero but is almost always positive. Since, 
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by (V-79), (t) is the sum of autocorrelation 
and cross correlation functions, its Fourier 
transform, 4(w) , is the sum of spectral den- 
sities and cross spectral densities. Since 
the spectral density (or average power density) 
is never negative, $(w) is never negative . 
However, #(w) could be zero, but since it 
represents a random process, the probability 
of its being zero is very small. 

3. %(w) is almost continuous. Since the 
signal or noise may have non-zero means or 
oscillatory components, the spectral density 
may have infinite peaks at discrete frequencies. 
So ¢(w) may have 6-function peaks super- 
imposed on a continuous spectrum and will be 
considered almost continuous. 

4.  $(w) is zero for sufficiently large w. It 
is required that 


lim $(w) = 0 
a~ @ 


in order that #(w) represent a physical sys- 
tem. If this were not the case, the average 
power dissipated in the system would be infi- 
nite, which is of course impossible. 


$(w) will be approximated by the ratio of two 
polynomials and expressed as 


5 a, w® ) 
P(w) ino 6! 
Q(w) n ‘ 
(3, ae ) 


Since ¢(w) is never zero except as w~-®, P(w) 
has no real roots. Then, because complex roots 
occur in pairs, ™ must be an even integer. Fur- 
thermore, since ¢(w) is almost always finite, 
Q(w) #7 0, and by the same argument as for a, 
n must be an even integer. Finally, since ?#(”) = 0, 
n> Oo. 


(V-96)  (w) « 





Now factor the numerator and denominator poly- 
nomials and remove the coefficients of the leading 
term. Then the polynomials can be replaced by 


a/2 m/2 ‘ 
P,(w) = c 1, (o- a,) fe ay) 
V-97 

: : Q.(w n/2 n/2 ° 
1(#) » J, (w- Bi) iQ, (w- B,) 


where the a, and f, are roots which have nega- 
tive imaginary parts, andthe a, and 8, are 


roots which have positive imaginary parts, and 
ce a/b,- 


If the functions ¥%(w) , and its conjugate, ¥*() , 


V-46 
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are defined as 
MN (oes) 
@- & 
Ww) evo ast 
B/ 2 (w- B,) 


and i=} 
a/2 


(V-98) 


(w- a) 
(a) ote ees 
"fe (w- BS) 
is] 
can be "factored" in the form 


(V-99) 


then $(w) 


(V-100) $(w) = ¥(w)P*(w) 


From (V-98), (ww) is a function whose zeros 
and poles occur in the lower half of the complex 
plane, and from (V-99) ¥*(w) is a function whose 
zeros and poles occur in the upper half plane. 


So ¥(w) is analytic in the upper half plane and 
¥*(w) is analytic in the lower half plane. The 


required factorization has been carried out and 
it is now possible to obtain a solution to the inte- 
gral equation (V-95). 


SOLUTION TO THE INTEGRAL EQUATION . 
From (V-100), by the Fourier convolution integral 
formula, 


(V-101) P(ty= J ¥O(T)¥(to TdT 


where ¥Y (t) is the inverse Fourier transform 
of ¥(w) Substituting (V-101) into (V-95), the 
integral equation to be solved is 


(V-102) h(o+t) “Jo M(u)duf We (Tt) ¥(teT-u)dT 
for t 20 


Interchanging the order of integration, (V-102) 
may be rewritten in the form 


(V-103) h@st) »J” ve (x) def “M(u) #( tot) du 
for t20 


Equation (V-103) will be solved by the simple 
artifice of partitioning the equation into two equa- 
tions and two unknowns, and then eliminating one 
of the unknowns. 


Define 


(V-104) — e(t) = ['M(uyy(t- udu for t 20 


Then (V-103) may be rewritten as 


(V-105) hia +t) e« Swe(ne(ts ad t for t 20 


(V-104) and (V-105) represent the two equation 
partition of (V-103) in the two unknowns e(t) and 
M(u) . They will be solved simultaneously by 
eliminating e(t) To effect a simultaneous 
solution of the equations, it is necessary to use 
the following relationships: 


(V-106) y(t-u) = 0 for t<u 

(V-107) Mu) = 0 for u<0O 

The justification for these equations is discussed 
in greater detail at the conclusion of the derivation. 
Since in (V-104) u assumes nonnegative values 
only, fort <0, y(t-u) = 0. This statement 
follows from equation (V-106). Using this result, 
e(t) may be expressed as 


e,(t) =f M(u)y(t-u)du for t > 0 
(V-108) e(t) = : 
0 for t <0 


E(w) , the Fourier transform of e(t) , is defined 
as 


(V-109) E(w) = fe(tye sot dt » fre(tyes iat dt 
¢ Jrectye sot dt 

Substituting (V-108) into (V-109), 

(V-110) E(w) = igre dtf“M(u) y(t-u) du 

or 


(W-E1t) E(u) » frat f “du w(u) y(t-u)e7I%t 


In (V-111), let t-u-e r, and interchange the 
order of integration. Then 


E(w) » fduf "arm (u) y(rye7Ie(utr) 
or 
(V-112) E(w) = fduM (u) e7 Jeu [var y(n) e7 JeF 
Rewriting (V-112), 
(V-113) E(w) = Jrdu wcuper Sou] (y(n) er Sor dr 
=u ] 


In this equation, it is seen from the range of inte- 
gration in the first integral that u >0. So by 
equation (V-106), 


wir) = 0 for -™<¢ rg -u 
‘Therefore, the last integral in (V-113) vanishes, 
and the equation may be rewritten as 


(V-114) E(w) = Sau Mu) e* Jou im w(rje"Jor dr 


Applying (V-107) in (V-114), 


(V-115) B(u) = J'u(uye"I* duf “y(rye" 39" dr 


The two integrals above are merely (m(w)) and 
@(w) , the Fourier transforms of M(u) and y(r), 
respectively. Rewriting (V-115), 


E(@) = m(a) P(e) 
or 


Ee) Td party e Jot at 
(V-116) m4) = 95) Moye the 


Substituting (V-108) into (V-116), 


i ee - jot 
(V-117) (a) Ma)’ e, (te dt 


e,(t) may be eliminated from (V-117) by solving 
(V-105) for e(t). 


Since for t20, e(t) = e,(t) , (V-105) may be 
expressed as 


(V-118) ho +t) « So (neg (t + t) dt 


It should be noticed that (V-118) is valid for all 
t since e,(t) is defined for allt. 


Taking the inverse Fourier convolution transform 
of (V-118), 

(V-119) e3@ Hw) © ¥*(@)E,() 

where E,(#) and H(w) are the Fourier trans- 
forms of e,(t) and h(t), respectively. Solving 
(V-119) for E,(w) and taking the inverse Fourier 
transform, 


: wd eset gy (ere Ho) 
(V-120) e,(t) ree te | ro 


Substituting (V-120) into (V-117), 


1 .e 1 we ei@e H(«) 
sae i e j@t a jwt 
m(w) Mar’ ° dt ante" du ric 


Chapter V 
Section § 


For clarity in the last equation, replace the dummy 
variables t and w by t and x, respectively. Then 





1 e jae e ei t( rte) 
(V-12!) mo) FO” TL, Oe 
N(x) ay 
¥*(x) 


Taking the inverse Fourier transform of (V-121) 
provides the required memory function 


1 .e 
- Jwt 
M(t) re m(w) dw 
or 
1 @ @ e 
a jwt °jwr §3( re) 
M(t) res I. e dof @ drf e dx 


(V-122) H (x) 
¥(w) ¥* (x) 


Equation (V-122) is the desired memory function 
which provides the minimum mean squared system 
error, where 


H(x) © frenItt h(tydt = Jems **[Rye(t) 
+ Ryg(t))dt 

$(w) = f.ersot p(t) dt = f-e"4#t[Ree(t) 
¢ Reg (t)+Rge(t) Rg g(t) dt 


ak 2 ak 3 
$(w) « 25 a wa" / 3. bi wate! 


(V-123 Qo k, i, 
Hw) » lz H(o- ay / Oi (o- Bd 


Bo my e Ky @ 
¥*(x) = |/— J (x- af / n (x- By) 
Do iel is} 


m8 <9, PPh cg, (4;,B;, complex) 


$(w) = ¥(w) ¥*(w) 


The only step in the derivation yet unexplained is 
the demonstration of equations (V-106) and (V- 
107). The proof of (V-106) is almost identical to 
the proof of the statement that W (t) = 0 for 
t< 0, given in the Appendix. Since ¥ (w), the 
Fourier transform of Y(t), is analytic and bounded 
in the lower half plane, ¥ (j w) is analytic and 
bounded in the right half plane. Then ¥(jw) may 
be treated as the transfer function for a stable 
Bystem, and the proof in the Appendix is directly 
applicable. 


V-47 
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Equation (V-107) can be demonstrated as follows: 
S{nce, by equation (A IX-6) in the Appendix, 
W(t) = 0 fort< oO and since equation (V-83) 
must be satisfied for all t, 


M(t) + n2(t) = O for all t < 0 


However, since ) may be chosen arbitrarily , 
it folfows that both M(t) and Z(t) must be zero 
for all t <0. 


(d) DISCUSSION AND EXAMPLE OF RESULTS 


This subsection discusses the scope and the physi- 
cal application of the theory. It also presents 
a practical procedure by which a physical system 
can be synthesized and illustrates the procedure 
with an example. 


In order for this theory to be applied, the general 
character of both the message and noise inputs 
to the system under investigation must be known. 
In the synthesis of many physical systems, the 
nature of the message and/or noise cannot be 
established from past experience. Therefore, 
some assumptions (which will vary according to the 
problem) must be made regarding their character. 


Since the solution of this problem is presented 
in analytic form, and since, in many cases, some 
of the autocorrelation and cross correlation func- 
tions appear only in the form of time records, it 
is generally necessary to approximate the time 
records by analytical expressions. These ex- 
pressions can then be substituted into a final 
equation for the memory function. 


It should be noted that the entire derivation of 
M(t) was independent of the sign of ©. So equa- 
tion (V-122), the expression for M(t), is valid 
for interpolating, extrapolating, and duplicating 
systems. Furthermore, the basic theory is suf- 
ficiently general to be applied to problems other 
than mere prediction. For example, an important 
practical problem is that of determining the deriy- 
ative of a message which is corrupted by noise. 
In most cases of interest, the message is a low 
frequency signal, and the disturbance is a high 
frequency noise. Applying the theory to this 
situation (assuming the cross correlation functions 
to be zero), the expression for 4(t) becomes 


Jwt 

e 

1 eee dw} Perdue dt 
0 


1 
os 4n? Jo ¥(w) 


(V-124) 
wo jxv,(xyet?” 
-@ ¥* (x) 


where ¢,(w) is the Fourier transform of Rre(t), 


V 


and 


O(t) = Reg(t) + Reg (t) 
(V-125) 
$(w) = ¥(w) ¥*(w) 


This expression for M(t) is that memory function 
for which the mean squared value of the difference 
between the system output and the derivative of 
the message is a minimum. 


Before applying the theory presented above, it is 
necessary to consider the problem of perfectly 
predictable components of message and noise. 
Such portions of the input signal must be "sub- 
tracted out.'' Examples of perfectly predictable 
components are fixed biases (the dc means) and 
oscillatory functions. The presence of either of 
these can be detected quite readily by examining 
the spectral density functions. If either the mes- 
sage or noise has a non-zero mean or periodic 
terms, the spectral density will contain delta 
function type peaks. 


The presence of such peaks does not permit the 
necessary factorization process discussed earlier. 


A step by step procedure for employing the Wiener 
theory in physical applications is outlined below: 


Step 1. Establish the type of messages the physi- 
cal system must accommodate. 


Step 2. Establish the type of noise which is ex- 
pected to accompany the message. 


Step 3. Either by assumption or by numerical 
methods (this is generally a computer problem) , 
establish the autocorrelation and cross correlation 
functions of the message and noise. The cross 
correlation functions will usually be zero. 





Step 4. By graphical addition, form the functions 
g(t) and h(t). 


Step 5. By a least squares method of curve fitting 
(or by some equivalent technique), establish an 
analytic approximation to the graphical forms of 
$(t) and h(t), 


Step 6. Analytically calculate the Fourier trans- 
forms of ¢(t), h(t), @(w) , and H (w), 


Step 7. From plots of ¢(w) and H(w) , determine 
wheth:r or not any perfectly predictable com- 
ponent:; are present. If they exist, subtract them 
out anc then proceed. 


Step 8. Express the analytic form of ¢%(w) as the 


ta—_——_. di». 


— finan 


we ty tw tb a wl Ud So es a a si as 


ratio of two even degree polynomials, and factor 
them. 


Step 9. Let ¥(«) be that portion of © (#) whose 


zeros and poles occur in the lower half of the 
complex plane. Then %°(w) is that portion of 
#(«#) whose zeros and poles lie in the upper half 
complex plane. Then it follows that 


| $(w) = P(w) 2*(w) 


Step 10. Substitute (w), (0), and H (w) into 
equation (V-122), and solve for M(t) , the optimum 
memory function. 


Step 11. Construct the physical system which 
corresponds to a(t). This can be effected, for 
example, by taking the Laplace transform of 
M(t) to obtain the transfer function of the system. 
Then the usual methods, discussed in earlier 
chapters, apply. 


The above procedure will now be illustrated with 
an example. For simplicity, the cross correlation 
functions will be taken to be zero. Applying step 
2, let the noise signal be due to a shot effect. + 
Then applying step 3, approximate the noise with 
a white spectrum; that is, let 


$gg(w) = N2 


where %,,() is the spectral density of the noise, 
and N is a constant. 


For the message, let 


Fre() = 
where ¢¢r(w) is the spectral density of the 
message. Since all functions concerned have 
been defined analytically, steps 4 and 5 can be 
eliminated. Proceeding to step 6, @(w) and H (w) 
are given by equation (V-123). Since Rr,(t) is 
taken to be zero, H (w) is merely the spectral 
density of the message, or $¢ ¢(w) 


So 
1 
HO Ta 


From equation (V-79), #() isthe sum of the 
spectral densities of the message and noise, or 


+ ‘Mathematical Analysis of Random Noise,’ by 
S.0. Rice, Bell System Technical Journal, Vol. 
23 (1944), pp, 282-322, and Vol. 24 (1945), pp. 
46- 156. 
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$(w) = S¢¢() + gg (we) 


1+N?2+ N40? 


ina 
$(«) a aT a : 1+? 


Proceeding with step 7, it is seen that no oscil- 
latory components are present in the data. Con- 
tinuing with step 8, it is seen that #() can be 
factored by letting 


Ji+N?e Njo 


2(w) s 1 + jo 


J1+N7- Njo 


il aaa BT 


Then it follows that 


$(w) = Pw) 2*(w) 


Substituting the expressions above for °(), 
e*(w) , and H(w) into (V-122), according to 
step 10, 


M(t) = za free due" 47 dtfe? B(r+oe) dx 


1¢ jw) (1- jx) 
(1¢ x2) Qi 6N7¢ Njw) (16 N2~ NJX 


Integrating with respect to x, 


wl?) x rte) 1- jx 
onze” sa Peery 1+ N“- NjX) 


ee WAI 8( rte) i 
xie® a aesry 1? N?- Njx) 


1° el t( rte) 1 


a ge ht 2) FE eg eee eee 
" ox se Neti eN@|1¢5x f1¢N7- Nix 


Using the fact! that 





and 


J ‘nouvelles Tables d’ Intégrales Définies,’ by 
D. Bierans de Haan, ed. of 1867, corrected, G. 
E. Stechert and Co., New York, 1939, Table 160. 


v-49 


Chapter V 
Section 6 


then 


a freit(rte) dx l- jx 
a (14 x2) (UT eNT- Njx) 


e® (rte) 


NeS1¢N2 


for t>-¢ 


Substituting this expression back into ¥(t), 


M(t) » — = o ofA(1sju) duly "0" ax| 
elieN+Njo 9 Nedioné 


@ elt (1, w) 
dwf er (itiwmrg 
a Sine iH 1, Trentsnjo i i 


° conn +ju) 1 


M(t) = sOcpinhS TTTN +Njw 1¢ jw 


or 


i eivt 


M(t) = ONS Tr =n T+ Nt Njo 


This last integral could be evaluated and found to 
be 


l ge (othV TNT) 
M(t) = N(N+#¥1¢N4) o-(es4 


However, this step will be omitted since the 
transfer function of the system will be more con- 
venient for physical interpretation. The transfer 
function, or equivalently the Laplace transform of 
M(t) , may be found in the following way: The 
Fourier transform of M(t), M,() , {8 obtained 
by inspection from the last integral; it is 


“Co 


€ 1 
Beers NodieN? S1eN7+Njw 


The Laplace transform is obtained from the 
Fourier transform by replacing jw by s, the 
Laplace variable, and the transfer function of 
the optimum system is M,(5) , 





M, (8) © TRON ETN ne * an 





where 
Ke NedleNS UL ONT 
and 
T = 2 
f1+Nn4 


It is now seen that the system which gives the 
minimum mean squared error is a simple lag net- 
work with a gain involving the prediction time ¢. 


SECTION 6 - SYSTEM OPTIMIZATION BY THE PHILLIPS METHOD 


This section presents a method of optimum system 
synthesis developed by Phillips. The section is 
divided as follows: 

(a) Introduction 

(b) Derivation of the Method 

(c) Dlustrative Example 


(a) INTRODUCTION 


The problem treated in this section is similar to 
that treated in Section 5. There is one important 
difference, however. An “absolute” optimum 
system memory function was derived in Section 5, 
whereas in this section a "relative" optimum sys- 
tem memory function will be derived. The rela- 
tive optimum is found by assuming a basic struc- 
ture for a system and optimizing with respect to 
its controllable parameters (such as gain or time 
constants). The assumptions and limitations 
used in the development of this method are identi- 
cal to those discussed in Section 5b except for 
the matter of physical realizability. In Section 5, 
no consideration was given to whether or not the 
optimum system could be practically realized. 
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Here, since the basic structure of the system is 
fixed prior to optimization, the question does 
not arise. 


(b) DERIVATION OF THE METHOD 


An optimum memory function will be derived in 
the following way: 
1. An expression for the mean squared error 
of the system will be established. 
2. This error will be minimized with respect 
to controllable parameters. 


For a definition of error, consider the block 
diagram in figure V-42. 


The error will be defined as the difference be- 
tween a desired system output and an actual sys- 
tem output. Since all systems which will be 
considered are linear, the error can be related 
to the system inputs by an equation of the form 


(V-125) (0) © Yu(Jo)M(w) + ¥y(Jw)N(a) 


Ne ee 


a 


Se 


apogee 


\ & 


te 


. 


Gat 
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where 


e(w) is the transformed system error 
M(w) is the transformed message input 
N(w) dis the transformed noise input 
Y,(jo) is the Fourier transform of the 
weighting function which relates 
system error to message input 
Y,(Jw) is the Fourier transform of the 
weighting function which relates 
system error to noise input 


Noise 


Actual [Actual System output 
System 







Ideal 
System [pesired System Output 


Figure V-42. System Block Diagram 


For a simple example which illustrates the der- 
ivation of equation (V-126), consider figure 
vV-43. 


N(8) 





Figure V-43. Illustrative Example 


For the system shown in figure V-43, which con- 
tains unity feedback, it is desired that theoutput 
C(s) duplicate the message input M(s). For this 
case, the error is expressed as 


(V-127 ) E(w) = M(wW) - C(w) 
By block diagram algebra, 


M(w) Ya N(u) 


tetas) See Teva, 1eiy 
Define 
1 
Yy(jw) = Te ¥i¥q 


stem Error 
bo 
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and 


Y3 
1*Yi¥q 


Then equation (V-128) reduces to equation (V-126) . 


Yy(J® * - 


In Section 4, it was demonstrated that the mean 
squared value of a function can be related to its 
spectral density by the equation 


(v-129) | x(t)|? = S-Gx(w)de 


i 
an 
Then 


an ee 
(V-130) | e(t)|? = SJ G_(1a) du 


Since the spectral density is an even function 
(see Section 4) or 


G.( w) be G.(-) 
then 


(V-131) |e(t)|?= Je Gg(uydu 


The error spectral density G,(w) must now be 
related to the system characteristics and system 
input which are used in equation (V-126). Such 
a relation can be found as follows: In Section 4c, 
property 5, it was demonstrated that R(w) and 
C (w) are the Fourier transforms of the input and 
output, respectively, and Y(jw) is the Fourier 
transform of the system weighting function, then 


(W132) G.(u) . [¥(Jo))? G,() 


where G,(w) and G,(w) are the spectral densi- 
ties of the input and output, respectively. By 
reasoning very similar to that used in deriving 
equation (V-132), the error spectral density may 
be related to the system characteristics and inputs 
by the equation 


(V-133) G,(w) = |Y,(jw) |? G.(w) + [Y, (Jo) |2G, («) 
+ Y8(J) Gan () Yq (jo) 
¢ Yu(jw)Gya() YR (J) 


where G, and G,. are the spectral densities of the 
message and noise, respectively, and G,, and 
G,, are cross spectral densities. The asterisk 
denotes the complex conjugate. 
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If equation (V-133) is substituted into (V-131), it 
is not readily apparent that G,(w) can be inte- 
grated. A table of integralst has been developed 
for performing this integration. The tabulated 
integrals are of the form: 


1 @ Gn(X) 


2nd fe Rm 


(V-134) I, 


where 
ha (x) = a,x" + a,x"" 1+... +a, 


&, (x) s b,x28° 3 + b, x28" 4,, ee +Da.y 


and where the roots of ha(x) all lie in the upper 
half plane. 


It will be found that, for linear, stable systems, 
the integral of the error spectral density may be 
expressed as the sum of integrals, each of which 
has the form of equation (V-134). 


After the error spectral density has been inte- 
grated, «2 will be expressed algebraically as a 
function of the controllable parameters of the 
system. If these parameters are denoted by 
a, i= 1, 2, 3, ..., Dp ,then the error may 
be expressed functionally as 

(V-135) €2(t) = £ {a,, 9,000, ap) 

The mean squared error can be minimized by 
applying the standard techniques of the calculus. 
Equations (V-136), 


of 
Oa, 





(V-136) = [Fe] = = 0 is 1,2,....D 
represent a system of P algebraic equations in Pp 
unknowns. These equations can be solved for the 
optimum values of the controllable system pa- 
rameters. The transfer functions obtained by 
using these parameter values provide the desired 
optimum system. 


(c) ILLUSTRATIVE EXAMPLE 


As an example, consider the system shown in 
figure V-44. 


By block diagram algebra, 


(V-137) €(S) = (38) 


i+ ¥,(8)¥q(8) © 
; -¥.(8) 
1+ ¥ (8) ¥9(8) 








N(8) 


+ Theory of Servomechanisms,’ by James, Nichols, 
and Phillips, p. 369. 
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Figure V-44. System Block Diagram 


1 


V-138) i —_—_—_———— 
: Yel) * Ty Cs) ¥g(8) 
and 

-Y,(8) 
(V-139) Y, (8) s 3 


le ¥ , (8) ¥.(8) 
Then (V-137) may be rewritten as 


(V-140) e(8) = ¥,(8)R(8) + ¥,(8)N(S) 


For continuity, equations (V-131) and V-133) are 
repeated here: 


(V-141) e2(t) = 7 £505 (u) du 


(V-142) G,(w) = | ¥_ (Jw) |2G,(w) +1 ¥, (Jo) |? 9, () 
+ Ya (J@) Gyn (W) ¥q (Ju) 
Yq (Jw) Gy (0) ¥q (Jw) 


Assume, for simplicity, that the message and 
noise are uncorrelated; that is, 


(V-143) 
Then 
(V-144) Ge(w) = |Y¥a(J) |? G_(w) +] Yq (Ju) |G, (w) 


Gan(W) = Gna(w) = 0 


As a second assumption, let the noise have a 
white spectrum; that is, 


(V-145) G,(w) = D 

where D is a non-zero constant. It should again 
be emphasized that it is impossible to realize 
white noise physically. The justification for this 
assumption is discussed in Section4d. example 3. 


As a third assumption, let the message input to 
the system have the autocorrelation function 


R(T) = e7Alz| 


where f is some fixed positive constant. It was 
demonstrated in Section 4 that such an ensemble 
has a spectral density 


(V-146) Gg (w) 


4B 
Beat 


ee ee ee ee ees ee ee ee See | 


a 


— 


Substituting (V-145) and (V-146) into (V-144), 
4B 

(V-147 ) G, (@) = | ¥, (Jo) | Bie ot + | ¥, (Jo) | 2D 

Consulting figure V-44 for the definitions of Y,(s) 


and Y,(8) , and substituting into (V-138) and 
(V-139), 








(V-148) 2 TS + l 
OE iors 
and 
1 
(V-149) Y¥,(8) = Ky crs 
where 
V-150) s i 
( Ks 1*K, 
(V-151 8 °° o=-., 
) Sears? 
and 
Ty 
(V-152) Te s i-K, = T,Ky 


Replacing s by ju in (V-148) and (V-149), and 
then substituting these equations into (V-147), 























(V-153) Ge(w) = |K, rn ort nt 
Substituting (V-153) into (V-141), 

(V-154) e8(t) ‘ PE fo oro atest 2 

For simplicity, let 

07939) FB ata Ey 
and 

1188) 6 Diese 

Then 

(V-157) e2(t) = e2(t)+ ef (t) 


The integrals in (V-155) and (V-156) must now 
be reduced to the form of equation (V-134). 


In (V-156), let 
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(V-158) h (w) = letjw = awea, 
where 
a, = TJ 
a « | 
Then, since 


|t,Jo+ 1]2 = (taJo+ 1)(T,Jw+ 1)° 


= (14+T,Jw)(1- Tajo) = b,(o)h, (-) 


K3?D dw 


e a eS h./avh. for 
(V-159) e, (t) 4n J, h; (w)hy (-@) 


In a similar fashion, in equation (V-155), let 


(V-160) H,(w) = (B+ jod(1+ T,J0) = a,w%+a ura, 


where 
a, = °T, 
a, = J(t,B+ 1) 
a, = B 

It is seen that 


1 1 
(V-161) H,(0)H3(-0) = B2+ 02 |[t2Jo 1)? 


Substituting (V-161) into (V-155), 


BK ec 14 +t Jol" 


-162) e2¢t Usa Cit 
Crenedd: Tee de Ha()H3(-«) 


Define 
l d w 
V-163 —. ase eee cine eee 
¢ 7 | nj- im @ hy; (w)hy(-) 
and 
. 1 @ &4(w) 
(Vv 164) I, QnJ5 Je Hg(«) Ha(-6) dw 
where 


(V-165) &4() = [1+ t,Jo|? 2 1¢t/ 


Then 
(V-166) eg? (t) = 2) BK? I, 
and 


K? Dj 





(V-167) e,7 (t) = 
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I, and I, may be evaluated immediately from 
the integral tables of Reference 11.* However, 
for the integration to be valid, the roots of h, («) 
and H2(w) must all lie in the upper half plane. 
Equation (V-158) indicates that 1/t2 must be 
Positive for the roots of h, (w) to lie in the upper 
half plane. Similarly, for H,(w) , (V-160) indi- 
cates that in addition to 1/t2 > 0, B must be 
positive. If these two restrictions are imposed 


on the problem, it is found that 
1 
V-168 ._—— 
( ) I; m0) 


and 
t2+B TH 
2B tT2)(1+ BT, ) 


Substituting (V-168) and (V-169) into (V-167) and 
(V- 166), 


(V-169) I, 


(to¢ BY) 
2B tTa4( 1+ B To) 





e.7 (t) = 2BK§ J 


and ; 
— Ky Dj 1 
2 Sect Tn eae 
earns 2 2%/ 
Substituting these relations into (V-157), the mean 
squared error is expressed as 
Ke to+B tT? DKS 


: et) “se 2 
(V-170) €2(t) tT, 1°B Tt, + 41, 





Substituting (V-151) and (V-152) into (V-170), the 
mean squared error may be related to the original 
system parameters by the equation 


es K +BTt D 
2 7 lair a ies? em pe 
(Yet), E80) bere K ron 


The only problem yet remaining is to minimize 
€2(t) with respect to the controllable parameters 
of the system. For this example, assume that 
8 , D, and K2 are uncontrollable parameters of 
the system and that they have been predetermined. 
Then (V-171) may be minimized with respect to 
the time constant 1, by differentiation: 


= (1+BT,K)-BK2(Kg+BT, ) 
ene =. 2 eee oC 


| 
aty 
Simplifying this expression and setting it equal to 


zero, 


* ‘Theory of Servomechanisms, ’ by James, Nichols, 
and Phillips, p. 369. 
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(V-173) 12 (48-48 K2 - DB2K2 )+t,(-2DEK,) 
¢ (-D) = 0 
The solution of (V-173) is 


pipK, B+ 14D e(i-_K?)} 


Oot a 4DB(1- Kk? )-(DBK,) 


Define 
a = (4DB(1- KZ) 
(V-175) 
bi DB K, 
Then 
Ysa yra 


a i Sr COTE, 


Assume that 21> 0, y>0. Then, if the negative 
sign is chosen, 
Y- a D 


i ee 0 
y= ay(ary) ary 


(V-177) +, * 


But, for the above discussion, it was necessary 
that ™, be >0, so this root must be discarded. 


If the positive sign is taken, 
y+a D 
(a- y) (a+ y) a- y 
D 


" {4DB(1- Kf)-DBK, 


For a solution to this problem, 1, must be posi- 
tive. This implies that « must be greater than 
Y. If ais greater than y , then from (V-175), 


(V-178) 1, =D 


4DB (1- K2) > D? B?7K3 


or 
1 
2 
K> must be less than DB iv 


and, equivalently, from equation (V-150), 
—— 


D 
(V-179) K, must be greater than “re ee | 


If the predetermined gain K, meets condition 
(V-179), then the optimal time constant 1, is 
given by equation (V-178). If the predetermined 
gain K, does not meet condition (V-179), no 
optimum solution exists. 


on~m; 


a ee eo ec cee ee oe ee 


—! 
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CHAPTER VI 
NON-LINEARITIES 


SECTION 1 - INTRODUCTION 


In most of the preceding work, the assumption has 
been made that physical systems can be described by 
linear differential equations of the type 


d’x a’ ty = gq?" 4 dx 
(VI-1) qea* Sigga-a* Sagpaqat’**'*Mn-1g et Aaxe Q(t) 


where the a, are constants. This assumption has per- 
mitted the development of analytical and graphical 
methods described in Chapters III and IV for the analy- 
sis and synthesis of dynamical systems. The validity 
of this basic assumption was discussed briefly in 
Chapter II. 


It is recognized in this chapter that (VI-1) only ap- 
proximates true physical systems. The coefficients 
are not ideally constant but vary as some functions 
of the dependent variable x; that is, (VI-1) will take 
the form 


avy q®”'x 
(VI -2) £,(*) ant f(x) atest’ tf, Cx" Q(t) 


where the f,(x) may be any functions of x and of its 
derivatives. 


When the coefficients of differential equations are 
some continuous functions of the dependent variable 
x , the equations are non-linear differential equations , 
and the systems described by such equations are said 
to possess continuous non-linearities. When the co- 
efficients of differential equations are some functions 
of the variable x but have finite discontinuities, the 
equations are non-linear, and the systems are said to 
have non-linearities of the discontinuous type. The 


f(x)]| continuous f(x)| discontinuous 


—————— oe X ———————s «= 


Figure VI-1. WNon-Linearities. 


two types of non-linearities are shown in Figure VI-1. 


Unfortunately, no general method of analysis or syn- 
thesis, such as discussed in Chapters III and IV, has 
been developed for real physical systems having non- 
linearities. A few writers have developed direct 
methods of treating scme non-linearities, but these 
methods are generally limited to specific cases and 
cannot be easily extended to solve the more general 
problems. However, since an assumed linear system 
lends itself so readily to analysis and synthesis, an 
indirect method for the consideration of non-linearities 
is available. This indirect method consists of finding 
an answer to the question: "An analysis or synthesis 
having been made of a system based upon linear con- 
stant coefficient equations, what would be the effect 
of certain non-linearities on the results?" If this 
question can be answered satisfactorily, the indirect 
method provides essentially the same information as 
would a direct solution of the non-linear equation. 


The best method for determining the effects of non- 


linearities on a particular system depends upon the 


nature of the non-linearities. For this reason, the 
non-linearities are, as mentioned before, divided into 
two basic types: continuous and discontinuous. Also 
since there is a great difference between the effect 
of large and small discontinuous non-linearities on 
a system, the discontinuous types are to be further 
subdivided into major and minor classes. 


Continuous non-linearities are usually eliminated 
from the differential equations of motion by assuming 
restricted ranges for the variables. By so doing, 
convenient linear relationships are obtained between 
such quantities as forces, torques, and moments. It 
is then desirable to determine if the non-linear terms 
in the original equations could lead to instability of 
the system. The first section of this chapter discusses 
a method, utilizing a theorem due to Liapounoff, by 
which it is possible to check such continuous non-linear 
equations for stability. 


Discontinuous type non-linearities are unavoidable 
in real physical systems. They are primarily due to 
the existence of friction forces, limiting, and free play 
or hysteresis effects. In addition to these unavoidable 
discontinuities, some types are added to a physical 
system to create special effects (spring preloading), 
or exist by the very nature of the system (relay con- 
trollers). These discontinuities are illustrated at the 
beginning of the second section of this chapter. 


vi-1 


Chapter VI 
Section II 


The discontinuous type of non-linearity, as such, 
precludes the application of Liapounoff's theorem, 
since a basic requirement of the theorem is that the 
functions f,(x) in (VI-2) possess continuous derivatives . 
As mentioned previously, the effects of discontinuous 
elements depend greatly upon their relative magnitudes . 
For sufficiently small discontinuities, the physical 
system approaches the assumed linear system with 
the discontinuous non-linearities having only a small 
effect on the system output. This small effect cannot 
be ignored, however, for its presence may be sufficient 
to cause sustained oscillations. 


If a sinusoidal function is used as the input to an 
element representing a small discontinuous non-line- 
arity, the output is almost sinusoidal. This similarity 
to a sinusoid suggests it can be adequately represented 
by the fundamental of a Fourier expansion. If the dis- 
continuous non-linearity is included in a closed loop 
and if the transmission of higher order harmonics 
about the loop is small relative to the transmission 
of the fundamental, the harmonics may be ignored, 
and the non-linearity represented by an equivalent 
transfer function with an amplitude-phase character- 
istic. In effect, then, the discontinuous system is 
approximated by a linear system as was done with the 
continuous non-linearities. With such an aid, a Bode 
diagram made for an assumed linear system may be 


revised, and the effect of the discontinuity determined . 


The methods used for determining the equivalent 
transfer functions of the minor discontinuities are 
discussed in the second section of this chapter. The 
possibility of steady state oscillations due to these 
non-linearities in systems is also considered. 


The third section of this chapter considers the 
major discontinuous non-linearities. These large 
discontinuities possess neither continuous derivatives 
nor negligible harmonics in the sinusoidal responses; 
hence, the methods discussed to this point cannot be 
used. Although the analog computer (Chapter VIII) may 
be used for the consideration of such non-linearities 
(as well as the other types), an analytical or graphical 
approach is desirable for a better understanding of the 
system and a check of computer results. 


The indirect method discussed in this section in- 
volves graphical analysis of simple second order sys- 
tems which contain one or more major non-linearities . 
It is recognized that most physical systems are more 
complex, but if the general effects of major non- 
linearities can be found for simple systems, an insight 
is gained as to possible effects of these major dis- 
continuities on a complex system. 


SECTION 2 - CONTINUOUS NON-LINEARITIES 


In designing a system based upon the linear approxi- 
mation of the system differential equations, it is 
recognized that the motions of the true system following 
some small disturbance will not be exactly as predicted. 
The validity of this linear approximation is of particular 
interest when used to predict the stability of the system. 
If the solution of the continuous non-linear equations 
indicates a condition of instability not revealed by the 
"linearized" form, linear approximations and the 
methods described in Chapters III and IV can not be 
realistically applied. 


The possibility of obtaining incorrect answers to the 
question of stability from the equations of the linear 
approximation was investigated by M.A. Liapounoff .* 
The results of his investigation may be summarized 
in the following theorem: "If the real parts of the roots 
of the characteristic equation corresponding to the 
differential equations of the first approximation are 
different from zero, the equations of the first approxi- 
mation always give a correct answer to the question 
of stability of a non-linear system.''** The theorem 
assumes only that the non-linear terms of the differ- 
ential equation may be expanded in a Taylor's series 
about the equilibrium point in question. 


According to this theorem, if all the roots of the linear 
approximation of the differential equation are negative, 


° Liapounoff, M.A., Probléme général de la stabilité 
du mouvement; Annals of Mathematical Studies, Vol. 17, 
Princeton Press. 


ee Minorsky, N., IJatroduction to Non-Linear Mechanics, 
J.W. Edwards, 1947, Aan Arber. 
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the non-linear system is stable about the point ta 
question, and any small temporary disturbance ina 
the input will result in a temporary disturbance in 
the output. If, however, any of the roots of the linear 
approximation of the differential equation are positive, 
the non-linear system is unstable about the equilibrium 
point and any small temporary disturbance at the input 
will result in an output which will diverge from this 
unstable point. 


If any of the roots of the linear approximation of the 
differential equation about the equilibrium point are 
zero, the theorem may not be used, and higher order 
terms of the Taylor series must be considered. Zero 
roots may result in a "conditionally stable" situation 
which would depend upon the direction of the dis- 
turbance. In servo work, conditionally stable situations 
are usually as undesirable as absolutely unstable situ- 
ations and hence, the fact that the theorem does not 
apply is of little consequence. 


It may be pointed out that although the linear approxi- 
mations of the differential equations indicate stable 
systems for all amplitudes of disturbances, the theorem 
applies only for small disturbances. 


Figure VI-2 illustrates simple stable and unstable 
equilibrium positions. If a ball is located at (a), a 
small disturbance in either direction will result in 
the return of the kil! to (a); and the system represented 
is stable about the equilibrium point (a). If, however, 
the ball is located at either (b) or (c) and disturbed, 
it will leave these equilibrium points, and the system 
represented is unstable about these points. 


ws es te ed ei i i ees at ss 


(b) (c) 


(8) 


Figure VI-2. Stable and Unstable Equilibrium 


To illustrate the application of the theorem, two similar 
second order non-linear differential equations will be 
considered: 


2 
ax dx 
ee aes @e 2 —_ as 
(vr-3) a Tey pw(l-x yae° Kx= Q 
d2x 9, ax 
(vI-4) a MER Get Kae @ 


When the acceleration and velocity are zero in these 
equations, the value of x defines the point of equi- 
librium, %; Chat is, Kx= Q or x* UK=x,. 


If a change of variable is made, such as x= x, + 5, where 
& is the deviation about the equilibrium point x,, (VI-3) 
becomes , 

a’s as 
(vI-5) eat wl l- (x24 ax 8 ¢ 54))—— + Kx +K8 =Q 


In accordance with the theorem, the first (linear) 
approximation of the term u[1- (x2 + 2 x8 + 82)) d&q¢ is 
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substituted into equation (VI-5) so that 


(VI-6) ata’ M(I-xg) S-+ K=O 


Equation (VI-6) indicates that the system is stable 
about all equilibrium points less than unity. AS x, 
approaches unity, the coefficient of d5/dt becomes 
very small and the system becomes poorly damped; 
but still stable for sufficiently small values of 8 about 
x,- Forx,=* 1, the coefficient of § becomes zero and 
one of the roots of the characteristic equation corre- 
sponding to (VI-6) will be zero. The theorem is not 
applicable in this case. For x, greater than unity the 
system described by (VI-6) is unstable. 


If equation (VI-4) is analyzed in the same manner, the 
equation corresponding to (VI-6) is 


(VI-7) mS- u(1-x2) 5+K5= 0 


For this case, the coefficient of § is negative for 
0<x< land the system is unstable about any equi- 
librium position in this range. For x,> 1, the coef- 
ficient of the & term is positive, and the system de- 
scribed by (VI-4) is stable for small & about x, . 


In general, it may be concluded that the analysis and 
synthesis of dynamic systems based upon the linear 
approximations of the continuous non-linear differential 
equations may be made with assurance that the question 
of stability will be answered correctly. It must be kept 
in mind, however, that the answers may be valid only 
for small disturbances about some equilibrium point . 
If the response of some dynamical system to a dis- 
turbance should be poorly damped, the system should 
be carefully analyzed; for the presence of some non- 
linear term in the damping coefficient may cause the 
true non-linear system to be unstable for very small 
magnitudes of disturbance. Or, stated in another way, 
the designer of a system described by linearized 
equations should satisfy himself that the damping 
coefficient is relatively independent of the non-linearity . 


SECTION 3 - DISCONTINUOUS NON-LINEARITIES 


(a) GENERAL 


Section VI-1 has dealt with the continuous type of non- 
linearity. Under certain restrictions, it was found 
that continuous non-linearities could be linearized, 
so that the methods of analysis and synthesis outlined 
in previous chapters could be used. Unfortunately, 
another type of non-linearity also occurs in most real 
physical systems. This type is the discontinuous non- 
linearity. 


The form in which discontinuities occur is varied. 
Figures VI-3 through VI-7 illustrate the static transfer 
characteristics of several of the more common types. 


Coulomb friction exists in all physical systems in which 
there is relative motion between two contacting sur- 
faces. The friction force is of constant magnitude and 
is always in such a direction as to resist the relative 
motion. The discontinuity in systems with coulomb 


friction occurs at the instant of a reversal in relative 
motion. Coulomb friction may be ignored only if the 
friction force is much smaller than the other forces 
acting. 


r4 


+a 


Figure VI-3. Coulomb Friction 


In certain cases, it is desirable to spring load a device 
80 that, when external forces are removed, the spring 
will cause the device to seek a null or zero position. 
The presence of coulomb friction, however, may cause 


VI-3 
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the device to stop short of the desired zero position. 
To overcome this, the spring may be preloaded by an 
amount equal to the coulomb friction force. Preloading 
introduces a discontinuity but is desirable for the above 
reason, 





Figure VI-4. Spring Preload 


In many physical systems, an input to the system must 
exceed a certain minimum value before any output is 
realized. One effect of this type is known as threshold 
or flatspot,and the value which must be exceeded is re- 
ferred to as the threshold value. Threshold is generally 
undesirable, and can be ignored only if the threshold 
value is much smaller than the input value. 





Figure VI-5,. Threshold 


Linear systems can transmit signals of infinite magni- 
tude. However, all components forming a real system 
have limitations on such quantities as position, speed, 
or voltage. In some cases, the limitations may never 
be reached, with the result that they need not be con- 
Sidered. In other cases, the limitations may be ex- 
ceeded and cannot be ignored. Limiting may or may 
not be desirable. 







Slope = K 


Figure VI-6. Limit ing 


In many physical devices, a plot of the input versus 
the output results in a closed curve called a hysteresis 
loop. The cause of such a loop in mechanical systems 
is referred to as the backlash or free play which exists 
between two mechanically coupled components. Hys- 
teresis is generally undesirable and should be elimi- 
nated wherever possible. 


For the cases in which the discontinuities may not be 
neglected without serious effect upon the results, it 


VI-4 





Figure VI-7. Hysteresis 


is desirable to have a method or methods available to 
determine such effects. This section of the chapter 
will discuss two such methods. The first method is 
applicable only to small discontinuities; while the se- 
cond may be used for any discontinuity, providing it 
occurs in a second or lower order system. 


(b) SMALL DISCONTINUITIES 


For ease in the analysis and synthesis of closed loop 
Systems, one of the methods of previous chapters made 
use of Bode diagrams in which the amplitude ratios and 
phase angles of transfer functions were plotted versus 
frequency. While these diagrams have not been empha- 
sized as frequency responses, they can be considered 
as such, since the curves are exactly those which would 
be obtained if the systems were stable and were excited 
with sinusoids of varying frequency. 


In this subsection, the non-linear elements will be 
replaced by "equivalent" linear elements. An "equiva- 
lent" transfer function will be derived by applying a 
Sinusoidal input to the non-linear element and by de- 
termining the Fourier series of the Output waveform. 
The "equivalent" amplitude ratio will be defined as the 
ratio of the fundamental output amplitude to the input 
amplitude. The phase angle will be defined as the 
difference between the phase of the fundamental and 
that of the input. The concept of such an "equivalent" 
transfer function is sound if: 
1. The system is oscillating at constant amplitude 
at the frequency considered. (This implies that the 
system is r unstable or that a sinusoidal input 
is being applied. ) 
2. The amplitude of harmonics appearing at the input 
of the non-linear element is negligible. This means 
that the transmission of these harmonics through the 
System (around the loop) is negligible compared to 
the transmission of the fundamental. 


A "small discontinuity" may now be defined as one 
Satisfying the above conditions. Since the non- line- 
arities considered here are not frequency sensitive, 
the ratio between the amplitude of the fundamental of 
the output wave and that of the input represents a shift 
in the amplitude ratio of the Bode plot. A similar shift 
may occur in the phase curve. 


The remaining portions of this subsection discuss 
the equivalent trar. .1.r functions of various non- line- 
arities, and their etfect upon Bode plots. Ratios of 
harmonic to input amplitude are derived to aid in deter- 
mining the validity of condition 2 above for a specific 
problem. 
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To obtain the frequency responses of discontinuous 
elements of the type discussed in this section, it is 
only necessary to analyze them at a single frequency, 
for they are not frequency sensitive. In general, the 
outputs may be represented by Fourier expansions of 
the responses written as functions of the amplitudes 
of the discontinuities and the amplitudes of the sine- 
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waves being transmitted through the elements. Pigures 
VI-8 through VI-12 illustrate the nature of the responses 
of discontinuous elements to sinusoidal inputs. If the 
amplitudes of the harmonics may be ignored when com- 
pared to the amplitudes of the fundamentals, the am- 
plitudes and phases of the fundamentals plotted against 
frequency would be the frequency responses or transfer 
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Figure VI-8. Transfer Characteristic of Coulomb Friction 
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Figure VI-9. Transfer Characteristic of Spring Preload 
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Figure VI-10. Transfer Characteristic of Threshold 
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Figure VI-11. Transfer Characteristic of Limit ing 
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Figure VI-12. Transfer Characteristic of Hysteresis 


functions of the discontinuities. 


In Figures VI-13 through VI-16 the amplitude ratios 
and phase shifts of the fundamentals and harmonics 
are plotted against the ratio of discontinuity amplitudes 
to element input amplitudes (8/A) to show how the rel- 
ative amplitude ratios vary. * 


From these figures, it is apparent that for very small 
discontinuities, the harmonic amplitudes are negligible 
compared to the fundamentals. However, as the dis- 
continuities become larger, these figures show an in- 
crease in harmonic amplitudes relative to the funda- 
mentals. In these latter cases the system equations 
must be examined to determine if condition 2 above 
will hold. This can be done with the aid of the Bode 
diagram. If the harmonics are not negligible, the dis- 
continuities are considered as large and will not be dis- 


¢ The ‘amplitude ratio’ of a harmonic to a fundamen- 
tal is an arbitrary term. and comletely ignores the 
difference in frequency existing between the harmo- 
nic and the fundamental 
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cussed in this part of Section 3. It is interesting to 
note that the discontinuity amplitude is not necessarily 
small relative to the input amplitude for the discon- 


tinuity to be considered small, e.g., the backlash case. 


To apply the amplitude ratios and phases of Figures 
VI-13 through VI-16 to a particular problem, it is 
necessary to have an open loop Bode diagram for the 
system. The primary frequency of interest is in the 
region of the crossover point (the point at which the 
amplitude ratio curve passes through zero db), be- 
cause it is within this region that the stability of a 
closed loop system is determined. The procedure to 


determine effects of discontinuities is as follows: 


1. Draw the Bode diagram for the linear system 
and establish an optimum gain. 

2. Assume that the system is oscillating at a fre- 
quency corresponding to the crossover point (point 
at which amplitu ‘e ratio curve intersects zero db 
line) and at constant amplitude. 

3. Assume that the harmonics of the Fourier series 
representing the output wave of the non-linear ele- 
ment are negligible. 
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SECTION 4— EFFECTS OF NON-IDEAL OPERATION 


In Section 3, it was pointed out that operational 
amplifiers are not ideal devices, They may be assumed 
ideal, however, if the effects which make the amplifiers 
differ from ideal can be made negligible. In this sec- 
tion, measures which minimise these effects will be 
discussed so that the operational amplifier may be 
used as ideal with a negligible error in results. If 
such steps were not taken, it would be necessary to 
make time-consuming calibration and correction com- 
putations. 


In the 0.C.voltage amplifiers used with most analog 
computers, the grid impedance, Z, , is made much 
larger than the input and feedback impedances. For 
these cases, equation (VII-5) may be simplified to 
that of (VIII-22). 


(VIII-22) *.. 2 
m % 1+ le 7 


For purposes of discussion, equation (VIII-22) may be 
put in the form of (VIII-23) 


Leh] | | 


wo that the error terma of the ratio -Z;/Z, will consist 
of a term which is a function only of the gain, and a 
second term which is a function of both gain and the 
impedances. 


For any given operational amplifier, the firet bracketed 
term of equation (VIII-23) is a constant, and usually 
cannot be changed. If the error introduced by this 
term is negligible in itself, attention can be given the 
second term. The second term will be frequency 
sensitive if the operation performed is integration or 
differentiation, and will introduce a phase shift. It is 
assumed that the permissible error is known, and that 
@ problem exists of determining an operating procedure 
which will keep the gain and phase changes within the 
acceptable limits. An examination of the second term 
will determine these limits of operation. 


Conaider the problem of addition. It can be shown that 
the equation corresponding to (VIII-23) is (VIII-24), 


(WIIT -23) 
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where Rt is the parallel combination of the input im- 
pedances. From the third, bracketed term, it is 
apparent that there is a limitation as to the number of 
voltages which may be added for any given feedback 
resistor, gain, and acceptable error in the non-ideal 
Operational amplifier. — 


In the case of differentiation, the second bracketed 
term of (VIII-23) becomes that of (VIII-25). 


i 
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(VIII-25) 


If jw is substituted for s, (VII-26) may be separated 
into the amplitude and phase expressions of (VIII-26) 
and (VIII-37). 


(VIII-26) Amplitude « 
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(VIII-27) eee tans 1 (Scat ) 
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Equation (VIII-26) when combined with the firet brack- 
eted term of (VIII-23) provides the means for determin- 
ing the permissible range in component values and 
frequency which will keep the amplitude error within 
the acceptable limits. Equation (VIII-37) provides 
the same information necessary for keeping the phase 
shift within acceptable limits. 


When integration is performed by the operational ampli- 
fier, the amplitude and phase contributed by the second 
bracketed term of equation (VIII-23) are those of (VIII- 
28) and (VIII-29). 


R,C,(K@ 1) 
VIII-28 litude> —pemp 
( ) — . opr Ee ) 7 
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As with the case of differentiation, these equations 
provide the means for determining the permissible 
range in component values and frequency which will 
keep the amplitude and phase errors below acceptable 
values. 


To discuss the steady-state accuracy of operational 
amplifiers when used as integrators, {t is convenient 
to do so in terms of the response to a unit step input. 
The unit step is chosen because the error will be larger 
than for any other possible input. 


Where the input impedance is a resistor and the feed- 
back impedance a capacitor, equation (VIII-23) may be 
written in the form of (VITI-30). 


e K 
(VIII-30) Bi BO Tye 
It may be noticed that this equation is of the same form 
as (VII-12); that is, the non-ideal operational ampli- 
fier nie like the ideal amplifier with a very large 
time ; 


The response of the integrating operational amplifier 
to a unit step input, as found from (VII-30), is de- 


(VIII-31) 0, (t) © -K (1- 0) for (K+ 1)RyCpwKR Ceo 


When expand”‘ in a power series, (VIII-31) takes the 
form of 
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for t/r< 1. Since the ideal integrator would have 
an output of-+/R;Cr, the term -t/2r is that fraction by 
which the output of a non-ideal integrator is in error 
for t « +. As apparent from (VIII-33), this error 
may be made small by making 7+ large. Since the 
RiCe product is a constant for a given operation, 
the error may be made small by using operational 
amplifiers with a large value of K 


It can be shown that the output voltage of an operational 
amplifier with drift is 


(VIII -34) 
e,*- 3 J o,+ —ty [Zee tle, 
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In this equation, the term ¢q is the drift voltage 
measured at the output of the 0.C voltage amplifier 
when the input is grounded. From (VIII-34), it is 
seen that the output of the operational amplifier consists 
of a term which would exist in a driftless amplifier, and 
aterm which exists due to the drift voltage. For 
large values of gain, this second term reduces to 
(1/K)(Z~-/Z,)+1]leq. While it may appear that a suf- 
ficiently large gain would eliminate the effect of drift, 
it must be remembered that the drift which appears in 
the output is due to the drift in the first stage of theRC. 
amplifier. Any increase in gain will also increase the 


drift voltage. 


If the operation to be performed is that of integration, 
the drift term takes the form (1/K) [(U/ 8R,C,) +1leg: 
that is, the drift voltage is integrated as well as the 
input voltage. 


Since the error due to drift is a function of time, it is 
a simple matter to measure the drift of an operational 
amplifier with no input and note the time it takes to 
exceed a specified negligible value. Any Solution ex- 
tending beyond this time is not within the required 
accuracy. The error due to drift may be minimized 
by using large amplitude signals, since the drift voltage 
is then only a small proportion of the total output signal. 


As shown by (VIII-20), the effect of grid current is to 
add a voltage to the output which is a product of the grid 
current and the feedback impedance. Though this grid 
current is small in well designed amplifiers, a suf- 
ficiently large value of feedback impedance may add an 
appreciable voltage to the output. The effect of grid 
current may usually be made negligible by restricting 
the feedback impedance to values of one megohm or 
less. 


In the next section, the use of operational amplifiers 
for the solution of differential equations will be dis- 
cussed. Though the assumption that the amplifiers 
are ideal will be made, it will be noticed that the value 
of the components and voltage levels used tend to mini- 
mize the undesirable effects of non-ideal operational 
amplifiers. 


SECTION 5 - SOLUTION OF DIFFERENTIAL EQUATIONS 


This section will discuss in detail the process of in- 
terconnecting operational amplifiers for the solution 
of a set of simultaneous linear differential equations 
with constant coefficients. The essentials of the pro- 
cess involved will be illustrated by use of an example 
involving a fairly complex set of equations. Speci- 
fically, the equations will be those of the longitudinal 
motion of an aircraft under the control of a simple 
autopilot. The autopilot is assumed to consist of a 
second order servo motor, a perfect rate plus dis- 
placement equalizer, and a single time lag hydraulic 
system between the servo motor and the control sur- 
face deflection. 


The equations of motion in question are as follows: 


(VIII-35) 
u -0.009u -0.0362w -32. 20 


(VIII-36) 


P Airframe 
w= -0.0821y -0.612w +8070 «25.25 


Equations 


(VIII-37) 
8 = -0.0006 w -0. 0028 w - 1.036 +8.978 


(VIII -38) 
Ge -126 -4000 +K [4+ K26] Servomotor Equation 
(VIIT-39) 


Se Ko +6 


Control Surf 
0.181 n rface Equation 


where: (All quantities are "perturbed" values from 
a steady-state equilibrium condition. ) 

uis the forward velocity of the aircraft. 

wis the vertical velocity of the aircraft. 

6 is the pitch angle of the aircraft. 

o is the output rotation of the servo motor. 

§ is the total contro! surface deflection. 

§,is an input disturbance to the surface. 

K, &K are equalizer gains. 

K,is the gain between servo motor and surface. 


It will be noticed that the three constants K,, K2, Ko, 
have not been specified. This has been done to provide 
a simple illustration for later use, to show how the 
analog computer may be used for synthesis. With 
these parameters available for change it is possible 
to optimize the performance of the physical system 
for which the balance of parameters is fixed. 


It should be noticed that the equations are written so 
that the highest derivative of the principal variable 
in each equation is isolated on the left side. This is 
done to facilitate setting up the computer. 


The control surface equation is an exception to this 
rule. Howev:r, the equation contains a simple time 
lag, and, as was stated in Section VIII-2, this is most 
conveniently represented by an amplifier with a parallel 
RC network in the feedback. 
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Consider the meaning of the first of the airframe equa- 
tions. Expressed in words, itstates that the rate of 
change of the quantity u is equal to a linear combi- 
nation ofu, w, and 6. In terms of the apparatus, if 
u, w, and 6 are each multiplied by the appropriate 
constant and added together (algebraically), the result 
isu. 


Section VIII-2 has already demonstrated that these 
operations can be carried out by operational ampli- 
fiers. However, close scrutiny shows that the quantity 

u is needed nowhere in the solution. What is really 
wanted is rather the quantity u. As has been mentioned 
before in this chapter, summing and integration may 
be combined in a single amplifier. The first equation 
may then be set up by the following arrangement of 
apparatus: 


Figure VIII-6. Mechanization of the 0 equation 


It should be noted that this connection of apparatus is 
equivalent to writing (VIII-35) in the form: 


(VIII-40) fudt «us f (-0,009 u-0.0362w -32.26 ) dt 


Nothing has yet been said about where w and 6 come 
from. However, it should be clear that by mechanizing 
the other equations and making the proper connections 
so that each quantity appearing as the output of an am- 
plifier is fed to the appropriate input, the various 
quantities involved will be related as described by the 
equations. Hence, if the completely mechanized sys- 
tem is disturbed in any manner at all, and thus caused 
to "move, " its motion can only be that which satisfies 
the equations. 


Another thing to be observed about figure VIII-6 is that 
while potentiometers, input resistors, and a feedback 
capacitor are indicated by the diagram, their numerical 
values do not appear. This will be taken care of later. 
They will be chosen so that not merely the general func- 
tional form of the equation is realized, but also so that 
the coefficients have the magnitudes occurring in the 
equations. 


The second of the airframe equations, (VIII-36), may 
similarly be symbolically represented in terms of the 
apparatus as: 





Figure VIII-7. Mechanization of the w equation 
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Here it was not possible to carry out the summation 
and the integration in a single amplifier, since w is 
needed for use in the equation for 6. Therefore the 
input quantities had to be summed separately. Also, 
the two reversals of sign in the summer and the in- 
tegrator give +w instead of -w which is needed in the 
6 equation. Therefore another amplifier has to be 
used to obtain the correct algebraic sign for this 
quantity. 


The third aircraft equation of motion may be set up 
in much the same way. The principal difference is 
that two integrations are required. 
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Figure VIII-8, Mechanization of the @ equation 


Here it will be observed that it has been necessary 
to provide both algebraic signs of 6 and of 6. The 
negative signs are used for the 3 and u equations but 
the positive ones will be required for the relation 
defining o. The +6 amplifier was taken off in a side 
branch instead of cascading all four amplifiers to 
reduce the number of amplifiers in the chain. 


The o and 5 equations may now be set up, and the 
interconnections of the apparatus are as shown by 
figure VIII-9. 


Notice that +o is not required since the additional 
sign change in the 5 amplifier gives rise to «3, which 
is needed for feeding back into the airframe equations. 
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Figure VIII-9. Mechanization of & and Equations 
Figure VII-9 represents the functional form of the 
above equations. There still remains the task of putting 
the appropriaie numbers into the mechanization. 


First it is necessary to select appropriate voltage 
levels, (i.e., how many volts are to correspond to 


VI-7 
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a unit of the physical quantity being represented). 
From experience, it can be said that linear quantities 
may be suitably handled by a scale factor of one volt 
per unit; that is, one volt may be made to represent 
one foot, foot per second, etc. Similarly, 100 volts 
per unit is usually suitable for rotational quantities, 
i.e., for units of radians, radians/sec_ etc. 


Consider again the i equation. The appropriate dia- 
gram is reproduced here for reference; this time the 
voltage levels are indicated: 





Figure VIII-10, Mechanization of & Equation 


It is now necessary to say what is meant by the "gain" 
with respect to a given input. Essentially, this is the 
number of units of the output quantity caused by the 
presence of one unit of the given input when all other 
inputs are held at zero. For example, inthe u equa- 
tion, if u itself is not fed back so that the u input is 
zero and no 6 input is provided, one unit of w must 
give rise to 0.0362 units of u. In symbols, this may 
be written | du/ow| = 0.0362. 


To recapitulate, if w is one ft./sec , the part of u due 
to w alone is 0.0362 ft /sec This discussion referred 
to the actual physical system. In the computer the 
corresponding gain depends on three things: It depends 
upon the voltage gain given rise to by the amplifier im- 
pedances, Z; andZ,;, the voltage attenuation introduced 
by the coefficient potentiometer, and the relative volt- 
age levels (volts/unit) of the quantities involved. The 
first two items are self evident. The third requires 
more detailed discussion. 


The analog operates on voltages and not on the physical 
units of the quantities represented. For example, the 
gain 2u/ew was found above from the ratio of the number 
of units (ft /sec.) of u caused by one unit (ft /sec ) of 
w. Inthe machine, the numerical value of the gain 
must be the same. However, if one unit of w were 
represented by a number of volts different from one 
unit of u, the presence of one unit of w at the input 
would have a different u response than would be ob- 
tained if all other conditions were the same and u and 
w were at the same voltage level. 


A general formula for du/aw may be written down from 
such considerations. 


(VIII-41) 


ou volt level 
& = (voltage gain of amplifier) x (YOitage level of 
oo ied Ceres level of u 


actual potentiometer settin ) 
* |full scale reading of potentiometer 
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For the example discussed, this reduces to 


au. _1 (1 volt/unit of w 
ow malt volt/unit o ") X (potentiometer ratio) 


Also from the equation for u, 2u/2w must be 0.0362. 
Since the voltage level ratio in this caSe is unity, it 
must be true that 0.0362 «= potentiometer ratio /R, ,C 


If C were 10°° farads and R,, were 10° ohms, the 
voltage gain of the amplifier would be unity, and the 
potentiometer would have to be set at 0.0362 times 
its all-in" reading. This is inconveniently low. If 
the potentiometer had 1, 000 divisions full scale, it 
would be necessary to set it at 36.2 divisions. At 
so low a setting, errors are serious on a percent- 
age basis. It would be better to take Riw as 10 x 106 
ohms, so that the amplifier voltage gain is actually 
an attenuation of 10. Then the potentiometer full 
scale setting would correspond to a au/ow of 0.1 and 
by setting it at 0.0362/0.1 = 0.362 times the total num- 
ber of potentiometer divisions gives the required w 
coefficient. 


This discussion neglects the loading effect of the input 
resistor on the potentiometer. As has been previously 
stated a correction to the setting is required to take 
care of this. However, this correction is easily found 
for a given potentiometer resistance and setting witha 
given input resistor, and calibration charts may be 
prepared in any given case. For the present, only the 
uncorrected potentiometer settings will be considered. 


In the case of the u output due to 6 input alone, the 
voltage level ratio is no longer unity. Here 


ou, 1 /100v/u 
0 RigC (1905 u ) X (potentiometer ratio) 


Also, from the equations, 0/26 = 32.2. Here 1/(R,4C) 
might be taken as unity; i.e., Rig - 106 ohms, C= 10-6 
farads; and the potentiometer setting as .322 of full 
value. It would be desirable, however, even in this 
case, to minimize potentiometer setting errors by 
getting a higher value of the potentiometer voltage 
division ratio. This can be done by taking R, 42.5 x 10® 
ohms, say, so that full potentiometer setting now 
corresponds to 2/06 =40, and setting the potentio- 
meter at 32. 2/40-0, 805. 


It is to be noted that such gains as 2u,,/ou,,, do not 
depend on the voltage levels around the loop since the 
factor (voltage level of u,, / voltage level of u,,, ) is 
necessarily unity. This is always true for any two 
quantities which occur in only one equation. 


Values may be assigned to the other inputs and potentio- 
meter settings in the airframe equations similarly. 


However, something more must be said in connection 


with the servo motor equation. Its diagram is shown 
in figure VI-11. 


The correspo.,'d:ng equation is 


(VIII-42) Gb -126 -4000 +K [0+ K,6] 
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By hypothesis, K, and K, are not known, since this 
is assumed to be a synthesis problem which requires 
finding values for suitable response of the system. 
This means that these two coefficients would have to 
be determined experimentally by trial of various com- 
binations of resistors and potentiometer settings and 
observation of the transients occurring in response to 
various inputs of interest. In this, the actual gains 
Figure VIII-11. Mechanisation of Servo Motor Equation K,K, and K, would then have to be calculated from the 
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Figure VIIF-12. Analog Computer Setup 
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R,’ 8 and the potentiometer settings, after these were 
known. 


However, there is another problem. The gain from ¢ to 
& is 400; that is, 2¢/20= 400; and while gains of 100 
or so across a Single operational amplifier are practi- 
cable if the amplifier is a good one, 400 is definitely 
much too high. This disposes of the obvious solution 
of making C= 10°* farads, R, = 2500 ohms Bo that 
1/R,, C = 400. 


This gain does not all have to be taken at the input 

o to the circuitry, however. It makes no difference 
if part of the gain is taken there, and the rest in passing 
through the other amplifiers in the cascaded chain. 


Suppose C - 10°, R,,=1/4 1 10°s 260, 000 ohms; then a 
gain of 4 is picked up across the first integrator. If 
then the input resistor to the sign changer is made 
0.1x10 ohms, and its feedback resistor a megohm, 
a voltage gain of 10 results at this point. A further 
gain of 10 may be taken in the last integrator by using 
a 0.1 megohm input resistor ‘and a microfarad feed- 
back capacitance. (This is preferable to a megohm and 
a 0.1 microfarad, since the first method reduces the 
impedance level. ) 


Then the gain around the closed o loop (without velocity 
feedback) is 400 as it should be. 


It is of great importance to notice, however, that 
something essentially different has been done here 
than if the gain were all taken at the input to the first 
integrator. In the latter case, the voltage level from 
input to output of the o amplifier would not have been 
changed. In the way the gain was actually taken, the 
voltage level has been raised twice, as shown in the 
diagram of figure VIII-11. 


If one volt is placed at the input of the sign changer, 
for example, and this represents one unit of o, then 
the ten volts resulting at the output of that amplifier 
can still represent only that one unit of the physical 
quantity 6; and hence the voltage level, the number of 
volts/unit of co, has been changed. It is essential to 
bear this concept in mind when the voltage represent- 
ing o is used as in the & equation here, as it is neces- 
sary to know the o voltage level so that the gain into 
the next equation may be properly calculated. 


The gain a/2o requires no particular effort; a gain of 
20 may be taken at this input by using a 50, 000 ohm 
resistor, and setting the associated potentiometer for 
600 (uncorrected). 


The gain 38/cc0=K, in the next equation is again not 
known. The voltage level of 8 may arbitrarily be 
taken as 100 voltsper unit which is convenient for 
feeding 8 into the w and 6 equations, and K, ultimately 
calculated on this basis. 


It remains only to determine the feedback resistor and 
capacitor in the & equation so that the time lag has the 
right magnitude to complete the mechanization of the 
equations (VIII-35) through (VIII-39). 


As was shown in Section VIII-2 the RC product here 
must be the value of the lag, 0.1 sec. in this case. 
This is easily obtained by using, say, a megohm re- 
sistor, anda 0.1 mfd capacitor. As has been pre- 
viously remarked, this can be a good paper condenser; 
the high-quality polystyrene type needed for integration 
is not required for use in time lag circuitry. 


Figure VIII-12 shows the complete diagram for the 
mechanization of the equations under consideration. 
All numbers are included except those to be deter- 
mined by the synthesis; those not computed above may 
easily be verified if it is desired to do so. 


This diagram has been drawn on the basis that all 

resistances are one megohm and all capacitances one 

mfd unless it is otherwise explicitly indicated. The 

convention has also been adopted that input and feed- 

back resistances of a sign changer are not drawn if 

they are the standard value so that the symbol 
10°Ohm 


—(>—— is equivalent to 10°ohm ra and 


also integrators are indicated by —-(~— for 
1_mfd 


ional . 


As a synthesis problem, the one here considered is 
very simple. However, if it were desired to do more 
than merely fix certain gains, that is, if it were desired 
to investigate the effects of various additional lags or 
to introduce other types of control, it is easy to see 
that these can be introduced into the computer by intro- 
ducing new apparatus and interconnecting it properly. 


Another interesting and important aspect of such prob- 
lems is to determine the effects of certain non-linear- 
ities, such as Coulomb friction or limiting, upon the 
behavior of the system. The machine means of repre- 
senting such discontinuities will be the subject of the 
next and final section of this chapter. 


SECTION 6 - SIMULATION OF NON-LINEARITIES 


(a) INTRODUCTION 


In the previous sections of this chapter, it was shown 
how the electronic operational amplifier could be used 
to obtain the solution of linear differential equations 
with constant coefficients. As was pointed out in @hap- 
ter VI, real physical systems may not be accurately 
described by this type of equation because of non- 
linearities which may exist. This section will discuss 
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methods by which it is possible to introduce these 
non-linearities in the analog computer for more accurate 
representation of physical systems. 


Since the simulation of non-linearities in the analog 
computer make. frequent use of the diode or polarized 
relay, a brief discussion of the general properties of 
these devices will aid the understanding of the circuits 
to be discussed. 
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The ideal diode is a device which will behave like a 
resistor of zero resistance for currents flowing in 
one direction, and a resistor of infinite resistance 
for currents flowing in the opposite direction. The 
non-ideal diodes possess neither of these features. 
In figure VIII-13 typical characteristic curves are 
shown for non-ideal diodes. The reciprocal of the 
slopes of these curves have the units of resistance . 
As shown by the relatively small slope for negative 
values of e, the resistance of the diode (R,) is quite 
large in value. As e increases through zero and ase 
sumes positive values, the slope of the curve increases, 
and the corresponding resistance decreases. For still 
larger values of e, the slope becomes relatively con- 
stant and determines the lowest resistance a diode 
may have. 


e) 
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Hot Cathode Diode Crystal Diode 


Figure VIII -13. Diode Character istics 


The polarized relays, as used in computation, are 
very sensitive devices. When no voltage is applied 
to the electromagnet, the armature is in a neutral 
position. When a voltage is applied to the electro- 
magnet, the armature closes either of two possible 
contacts depending. upon the polarity of the voltage 
applied. 
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Figure VIII -14, Simulation of Coulomb Friction 
with Polarized Relay 


Chapter VII .- 


Section 6 


(b) COULOMB FRICTION 


To simulate coulomb friction, it is necessary to have 
a device which will accept a voltage (representing 
velocity) and deliver a constant voltage (representing 
force), which will reverse in polarity when the voltage 
representing velocity is reversed. 


The polarized relay could be used alone to do this, 
but the voltage representing velocity would have to 
be relatively large before the contacts would close 
in one direction or the other. To overcome this diffi- 
culty, a high gain amplifier is used in conjunction 
with the relay as shown in figure VII-14. With the 
aid of this amplifier, the relay contacts close at a 
very small value of input voltage. The voltages E, 
and E, applied to the relay contacts are the voltages 
which represent the coulomb friction force. 


In figure VIII-15 the representation of coulomb friction 
is accomplished through use of biased diodes and oper- 
ational amplifiers. 


For zero output voltage the diodes are biased by the 
battery (B) so that both diodes represent very high 
resistances and effectively open the circuit. Since 
the battery (B) and the resistors (R) form a B.C. bridge, 
the voltage at point a equals the voltage at point b . 
For an output voltage equal to one-half the battery 
voltage, it may be noticed that one of the diodes must 
have twice the bias it originally had, while the other 
has zero bias, Any increase of e, above this value 
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Figure VIII-15. Simulation of Coulomb Friction 
with Diodes 


results in the conduction or lowered resistance of 
one of the diodes. Since this diode is in series with 
R, and the combination in parallel with the feedback 
resistor, the effect of a conducting diode is to lower 
the operational amplifier gain. This reduction in 
gain prevents the rise in output voltage which would 
normally be associated with a given rise in input volt- 
age. Asa result of the changing diode resistance and 
reduction of a .,:lifier gain, the output voltage remains 
essentially coustant. High gain amplifiers are used 
in this circuit for the same reason as with the polarized 
relay circuit. 
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Figure VIII-16. Simulation of Spring Preload 
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Figure VIII-17. Simulation of Threshold 





(c) SPRING PRELOAD 


To simulate spring preload, the circuits described for 
coulomb friction may be combined with one operational 
amplifier connected as an adder as shown in figure 
VilI- 1 6 ° 


(4) THRESHOLD 


The simulation of threshold may be accomplished 
through a circuit similar to that of figure VIII-17. 
As shown by this figure, the diodes are non-conduct- 
ing (very high resistance) when the input voltage is 
zero. For input voltages exceeding the bias voltage, 
one of the diodes conducts (lowered resistance) and the 
output voltage becomes OR, / (R, + Ry + Rp) ) (e, -e) * In 
this circuit, R, must be small compared to R,. Since 
the output of the diode circuit will interact with the 
input of the following operational amplifier, the thres- 
hold circuit must be connected to the circuit with which 
it is to operate when calibrating. 
+R, is the resistance of the conductive diode- 


(e) LIMITING 


A simple method of simulating limiting is shown in 
figure VIII-18. When R is small relative to the input 
impedance of the following stage, but still large com- 
pared to the resistance of a conducting diode, the out- 
put voltage will be that of the input until one of the 
diodes conducts and prevents a further increase in 
the output voltage. 


(f) HYSTERESIS 


The circuit of figure VIII-19 may be used to simulate 
hysteresis. As an aid in understanding the operation 
of this circuit, it may be recalled that the grid voltage 
of an operational amplifier is effectively zero. As may 
be seen by the figure, any positive input voltage large 
enough to cause one of the diodes to conduct will charge 
the condenser, C,, toa value equal to the input voltage 
minus one-half the bias battery voltage. As the input 
voltage begins to decrease, C, will maintain the voltage 
at point (A) at a constant value until the input voltage 
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Figure VIII-18. Simulation of Limit ing 
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Figure VIII-19, Simulation of Hysteresis 
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has been reduced sufficiently to cause the other diode 
to conduct. When this second diode conducts, C, has a 
voltage equal to the input voltage plus the bias voltage. 
The feedback impedance of the operational amplifier 
is made a capacitive reactance to prevent differen- 
tiation due to the fact that the input impedance is a 
capacitive reactance. 


(g) CONTINUOUS NON-LINEARITIES 


Up to this point, the diodes have been used to simulate 
discontinuous non-linearities. In figure VIII-20 the 
use of diodes to approximate a smooth curve by straight 
lines is illustrated. This circuit is similar to figure 
Vili-15. The difference in this case lies in the re- 
sistances placed in series with each diode. These 
resistors permit the changing of the effective feed- 
back impedance in steps. The diodes serve to switch 
in each resistor when the output voltage reaches a 
certain value. 


The circuits described above are not necessarily the 
best ones for the particular non-linearities simulated. 
They are circuits which have been used; and serve to 
show how a few auxiliary components can be used to 
represent the majority of non-linearities. 
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APPENDIX 
SECTION A-— TABLES, CHARTS AND GRAPHS 

The pages immediately following include certain charts that are useful in design. 

Some of them'have been discussed in the text. Others not discussed are included 

because of their general interest. 
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Figure VI-13. Amplitude Ratio and Phase 
Due to Spr ing Pre load 


4. Determine effect that the fundamental of the 
non-linear element output has on the Bode diagram. 
5. Check the validity of step 3. 


In general, if the amplitude ratio of the discontinuous 
element is greater than unity (zero db), the closed 
loop system becomes less stable. If the gain is less 
than zero db, the closed loop system becomes more 
stable. As will be shown in one of the examples to 
follow, it is possible to have a combination of am- 
plitude ratio and phase lag with a resulting insta- 
bility of a system which is stable when discontinuities 
are not present. Several examples will now be dis- 
cussed in which the method outlined above will be 
applied to the simple positional servo illustrated in 
figure VI-17. 


The closed and open loop differential equations de- 
scribing this system are, respectively: 


t d*c_ dC 
2 
(VI-8b) dB, 1 dB, KiKe 5 


In each example, it will be initially assumed that the 
harmonics have a negligible effect. Following this, the 
validity of the assumption will be checked. 


Chapter VI 
Section 3 


COULOMB FRICTION. Figure VI-8 illustrates. the 
transfer characteristics relating the coulomb friction 
force to a sinusoidal velocity. When the harmonics 
are neglected, the response of the non-linearity is 
given by the first term of the Fourier series, or 
F(t) = (4a/7) sin at. The transfer characteristics 
corresponding to this first approximation are illus- 
trated in figure VI-18. The figure shows that the 
slope or "gain" has the units of viscous friction; that 
is, the first approximation to coulomb friction is 
viscous friction. 


If the output of the closed loop system of figure VI-17 
is subjected to this "effective" viscous friction, the 
differential equation written with the first approxi- 
mation becomes 


(VI-9) r 2S. 90( +48) KK ec + KAR 


From this expression, it is concluded that the effect 
of coulomb friction on the system of figure VI-17 
(viewed in this way) is to increase the damping ratio 
without changing the frequency. It is to be further 
noted that for a given value of coulomb friction, the 
effective coefficient of viscosity approaches infinity 
as the input amplitude approaches zero. . 


Equation (VI-9) may be written in the form of (VI-10) 
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Figure VI-14, Amplitude Ratio and Phase 
Due to Threshold 
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2 ddition of coulomb friction to the closed 1 syst 
VI- , ac . _ 48. ac) a ction c oop system 
(VI-10) or $+ GE + KK eC K, (R nK,A dt of figure VI-17 effectively adds another feedback path. 
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Figure VI-16. Amplitude Ratio and Phase 
Due to Hysteresis 
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Figure VI-15, Amplitude Ratio and Phase 
Due to Limiting Figure VI-17. Position Servo 
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Figure VI-18. Effective Characteristics of Coulomb Friction 
when Harmonics are Neglibible 





Figure VI-19. Position Servo with Coulomb Friction 


The open loop Bode diagram of figure VI-19 is shown 
in figure VI-20. 


It is evident that decreasing amplitude A of the con- 
trolled variable (input to coulomb friction block) in- 
creases the open loop gain, thus resulting in an in- 
crease in the apparent damping ratio of the closed 
loop system. 


The Bode diagram shows that at the frequency of the 
third harmonic the signal is attenuated 9.5 db below 
its amplitude ratio at the fundamental frequency. The 
Fourier expansion accompanying figure VI-8 reveals 
a further attenuation of three (9.5 decibels) due to 
the feedback element. With such a large attenuation 
of the harmonics relative to the fundamental, it can 
be concluded that the harmonics contribute little to 
the stability of the system. 


SPRING PRELOAD. Figure VI-9 illustrates the trans- 
fer characteristics relating the force, applied by a 
preloaded spring, to a sinusoidal displacement. When 
the harmonics are neglected, the response of the non- 
linearity is given by the first term of the Fourier 
series, or F(t) © [AK ¢ (4a/7) ) sin at. The transfer 
characteristics corresponding to this first approxi- 
mation are illustrated in figure VI-21. | 


As indicated by this figure, the preloaded spring is 
effectively replaced with a spring with a coefficient 
of K+«(4a/nA). The closed loop differential equation 
written for the system of figure VI-17 when loaded 
with the above spring is 
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d?C, dc 4a 
(VI-12) 7 4t2- dt +[tanes(K 42) Ce K,R 


The addition of this spring increases the natural fre- 
quency and decreases the damping ratio of the system. 


Writing equation (VI-12) in the form of (VI-13) 


: ac , ac (A 
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Figure VI-20. Open Loop Bode Diagram of 
Systea with Coulomb Fr ict ion 
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Figure VI-21. Effect ive Characteristics of Spring Preload 
when Harmonica are Neglinible 
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permits drawing figure VI-22. As with the previous 
case, a preloaded spring may be represented by the 
addition of a second feedback path to figure VI-17. 
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Figure VI-22. Position Servo 
with Preloaded Spr ing 


The open loop Bode diagram of figure VI-22, in which 
the term [K+ (4a/nA) } /K, i8 now part of the gain, is 
shown in figure VI-23. 
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Figure VI-23. Open Loop Bode Diagram of 
System with Spring Preload 


For increasing values of the ratio a/A,the gain increases 
with a resulting increase in the natural frequency of the 
closed loop and a decrease in damping ratio. 


As is apparent from the curves of figure VI-13 and 
the fairly rapid attenuation above the natural frequency 
shown by the Bode diagram, the harmonics have little 
effect on the stability as determined by the fundamen- 
tal alone. 


In the above cases it may be noticed that the addition 
VI-10 


of non-linear loads to the closed loop system of figure 
VI-17 effectively added a second feedback path. In the 
following cases, the feedback path of figure VI-17 will 
contain the non-linearities and the form of the figure 
will be unchanged. 


THRESHOLD. It will now be assumed:that the position 
servo illustrated in figure VI-17 has threshold non- 
linearity in the feedback portion of the loop. When the 
harmonics can be ignored, the curvesof figure VI-10 
are effectively changed to that of figure VI-24 with a 
slope of (K/7) (7 - 2B ¢sin 28) - ((4Ka)/(7A)) cos Bas 
determined from the first term of the Fourier series. 


Figure VI-24 also shows that K, becomes part of the 
gain of the open loop. If Kz is the effective slope, the 
differential equation for the system becomes 


(VI-14) ras. aC. K,KC = KAR 


From this, it is seen that a decrease in Kz results in 
a lower natural frequency and a higher damping ratio 
of the closed loop system. This is also illustrated in 
the open loop Bode diagram of figure VI-25. 


When the zero db line intersects the -40 db/dec portion 
of the Bode diagram, the rapid attenuation of the system 
above the natural frequency suggests the possibility of 
neglecting the harmonics. For smaller values of inputs 
to the non-linear element, however, the zero decibel 
line may cut the -20 db/dec line with the result that the 
over-all system gain at the third harmonic must be 
compared with the over-all gain at the fundamental. 
Although figure VI-25 shows the same harmonic at- 
tenuation for both locations of the zero db line, it must 
be remembered that the straight lines shown are as- 
ymptotes to the actual curve. At the natural frequency, 
w,, the asymptotes are below the true curve; and at the 
natural frequency, w/, the asymptotes may be above the 
true curve. Therefore, while attenuation in the un- 
primed case may actually be greater than 19 db, the 
attenuation in the primed case may be less than 19 db. 
As shown by the relative gains from figure VI-14, the 
third harmonic approaches the fundamental in gain as 
the ratio a/A approaches unity. In this range then, the 
discontinuity is not small and the stability of the system 
for small amplitudes of the controlled variable cannot 
be determined in this way. 


LIMITING. The position servo illustrated in figure 
VI-17 will now be assumed to possess limiting in the 
feedback portion of the loop. When the harmonics can 
be ignored, the transfer curve of the non-linearity, 
figure VI-11, is effectively changed to that of figure 
VI-26 with a slope 


, 1 _., B 2a (2)° 4a 4 
Be 1 28 f(a)" \, 48 fe 
: agains & -28 f.-(8)"), 8 f-(8)") 


as determined from the first term of the Fourier 
series. 


The differential equo:.on for this example is identical 
with that for threshold including the discussion which 
followed. The effect of limiting in the feedback path 
of figure VI-17 is to reduce the apparent natural fre- 
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Figure VI 25. Open Loop Bode Diagram of Syatem for Threshold or Backlash 
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Figure V1-26. Effective Characteristics of Liniting when Harmonica are Negligible 
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quency and increase the apparent damping ratio for the 
cases in which the input amplitude to the non-linear 
element does not exceed the limiting value by large 
enough values to invalidate the assumptions concerning 
the harmonics. 


HYSTERESIS. From the Fourier series accompanying 
figure VI-12, it may be seen that when the harmonics 
are neglected, an element containing hysteresis will 
have an effective shift of phase as well as a shift in 
amplitude. The gain and phase of the fundamental, 
as obtained from the Fourier expansion, are given 
by equations (VI-15) and (VI-16). 


(VI-15) 





Gain = i 
" 





1-u2 [3 - sin! u}+2(32- sin‘ u} leu? u 


u2- 1 


(VI-16)  Phase= tan"! 
[ #- sin@'u euli- u? | 


The change in gain and phase as a function of the ratio 
of discontinuity amplitude to signal amplitude is plotted 
in figure VI-16. 


Unlike the previous examples in which the effects of 
discontinuity were simple gain changes which could 
not make the system of figure VI-17 unstable, hys- 
teresis may cause the system to become unstable. 


Consider the case when backlash exists in the feed- 
back path. Figure VI-25 illustrates the open loop 
Bode diagram of the combination in which the con- 
trolled variable amplitude is much larger than the 
hysteresis range. In this range of amplitudes the 
effect of hysteresis is negligible. For smaller values 
of the controlled variable, figure VI-16 shows a de- 
creased gain and a phase lag for the feedback element. 
From the Bode diagram it is apparent that the phase 
lag tends to reduce the stability of the system. 


For a sufficiently small amplitude of the input to the 
non-linearity there will exist a combination of phase 
and gain change such that the zero db line cuts the 
Bode diagram at a frequency at which the phase passes 
through 180 degrees. For this particular amplitude 
and frequency, the system will oscillate with a con- 
Stant amplitude. This type of oscillation is called a 
"limit cycle." If the harmonics are negligible at the 
limit cycle, the oscillations will be sinusoidal. For 
such a case, the frequency of oscillations may be 
obtained from the Bode diagram, and the amplitude 
of oscillations from the amplitude ratio curves. 


(c) PHASE PLANE 


In part (b) of this section, a method was discussea 
which permitted the inclusion of small discontinuities 
in the analysis and synthesis of systems. It was empha- 
sized that if the discontinuities were not small relative 
to the inputs to the non-linear elements, the method 
could not be applied. 


The investigation of systems containing large dis- 
continuities by analytical and graphical methods is 
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laborious for all except the simplest of systems, since 
the differential equations change abruptly at the points 
of discontinuity. To carry out such investigations, the 
initial conditions for each new equation, following a 
discontinuity, must be determined from the previous 
equation at the points of discontinuity. 


Since discontinuous systems of normal complexity do 
not lend themselves readily to analysis by the available 
analytical and graphical methods, this part of section 
two discusses a method for determining the effects of 
large discontinuities on simple systems. While it is 
recognized that few complex systems may be approxi- 
mated by such simple systems, knowledge of the effects 
of discontinuities on these systems may sometimes 
provide an insight as to their behavior in the more 
complex systems. 


When a system can be represented by second order 
differential equations, the state of the system at any 
instant following some disturbance may be completely 
described in terms of the dependent variable and its 
derivative at that instant. Since these two quantities 
are all that are needed, a convenient method of de- 
scribing the motions of a system is to plot one against 
the other in a single plane called the "phase plane." 
The path followed by the point representing the state 
of the system at various instants of time then describes 
the complete sequence of events following the disturb- 
ance. Such a path is referred to as the "trajectory" 
in the phase plane. 


To illustrate the techniques used with the phase plane, 
a simple linear system will be analyzed in detail. This 
will be followed by an analysis of a similar system 
having spring preload as a discontinuous non-linearity. 
The techniques used with these illustrations will then 
be applied to several examples in which the feedback 
path of a position servo is subject to discontinuities. 


To introduce the phase plane, consider the undamped 
second order mechanical system described by equation 
(VI-17). 


2 
(VI-17) m ca ekx =0 


Since time must be eliminated as a variable to obtain 
an equation in terms of the position and velocity alone, 
equation (VI-17) may be multiplied through by dx/dt 
and integrated with respect to time: 

(n/2)(dx/dt)2 ¢ (k/2)x2 = h 


or 
ax 2 

(VI-18) dt/ , x2 24 
2h/m h/t 


where h is the constant of integration, evaluated from 
the initial conditions. 


If the substitutions (dx/dt) = y, a2 (2h/m) and £2 « (2h/k) 
are made, equation (VI-18) may be written as 


2 
(VI-19) 3° af ei 


Equation (VI-19) may be recognized as that of an 
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upon @ mass-spring combination will now be considered. 
The equation relating the mass-spring friction com- 
bination is that of (VI-31). 


o d?x ee dx e 4 
(VI-31) rth kx © -F sg at F 


If the substitutions F’ = -f, for’ (dx/dt) <0, F’=f, for 
(dx/dt) >0 , k=mo? and fo= ame? are made, (VI-31), 
may be written in the form of equations (VI-33) and 
(VI-33), which, upon integrating, become those of 
(VI-34) and (VI-35). 


3 
(VI-32) a4 wi(x-a)e0 for a <0 
(VI-33) ds a (x4 a) = 0 tor S>0 


2 
(VI-34) 1E sys” 1 for dx <9 


dt 
y,’ x," dx 
(VI-35) Th’ 2h/7,,2- 1 for at >0 


These latter two equations are those of ellipses in 
the phase plane. 
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Figure VI-31. Phase Plane; Second Order System with 
Coulomb Friction 


In this case the trajectories follow the ellipses with 
center atx- -a for positive values of (dx/dt) and the 






(1) sa =o for -a<x<a 
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ellipses with center at x = +a for negative values of 
(dx/dt , as shown in figure VI-31. It is of interest 
to note that the maxima form an arithmetic progression 
with difference -4a in contrast to the geometric pro- 
gression of linear systems. Also, it is evident in 
figure VI-31 that a steady state value other than zero 
is possible.* If the methods used with small discon- 
tinuities were applied to this problem, the possibility 
of a steady state value other than zero would not be 
apparent, since that method approximates coulomb 
friction with an effective variable viscous friction. 


Pa ee 
8(7T3 ¢ 1) 


Non- linearity 


Figure VI-32. Closed Loop System 






To illustrate the effects of discontinuous non-linearities 
on closed: loop systems, the positional servomechanism 
illustrated in figure VI-32 will be discussed for three 
types of discontinuities in the feedback path. It will 
be assumed in each case that the input is zero and that 
the motion of the output following some initial condition 
is to be determined. 
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Slope of Trajectories; 


dy . -A for -a <x<a 
dt2 dx 


2 
(2) a ¢ PL +Bx,-°0 for x>a dy e (Ae) for xa 
dt dt d 


x yy 


2 
(3) d“x3 r oka + Bx, »®Q for x<-a dy s ) for x<-a 
d¢? dt dx 


¥2 


Figure VI-33. Phase Plane; Clozed Loop System 
with Threshald in Feedback 


¢ At this value the spring restoring force is not 
greater than the coulomb friction force, and re 
further motion is possible. 
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(2) Ay + dR 0c For x>a 
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Figure VI-34. Phase Plane; Closed Loop System with Limiting in Feedback 


THRESHOLD. When the output is fed back through a 
component having threshold, it must exceed the thres- 
hold limits a and-a (see figure VI-5) before any signal 
reaches the input. To describe this system for all 
values of the output quantity, equations (VI-36), (VI-37), 
and (VI-38) can be written. 
3 

(VI-36) + rae -0 


for -a<x<a 


3 
(VI-37) ¢ my &. kjky(x-0) ° 0 for x>a 


VI-16 


(VI-38) + ays MX, i ka(x* a) = 0 for x<-a 


where x is the quantity fed back and k, is the slope of 
the threshold curve. By making the substitutions 
x,ex-a@ for x>a and x,=-xea for x<-a, these 
equations may be written, after rearranging, in the 
form of (VI-39), (VI-40), and (VI-41). 


(VI-30) eer © 0 


~acr< 
at fer -a<x<a 


mlm J rm ro ttt 


| 


\ 


= 


l 


\ 


\ 


i 


ee 


ne ee 


—— 


‘ost “at Pz oe J i | a | | 


CHAPTER Vil 
MACHINE METHODS 


SECTION 1 — INTRODUCTION 


In the preceding chapters of this volume various 
methods of analysis and synthesis have been discussed. 
It has been pointed out that the matter of primary 
interest in control systems work is the transient re- 
sponse; and the methods previously used have been 
considered from the point of view of obtaining approxi- 
mations to that response. 


All of these methods have certain defects, but are 
used to obtain a sufficiently close approximation to the 
transient. What is meant by sufficiently close at any 
point of the design process is a matter of judgment, 
but the essential point is that as design continues and 
more and more exact decisions have to be made, more 
and more complete and accurate information about the 
transient is needed. 


The methods heretofore discussed have been arranged 
in a hierarchy of utility. These methods are desirable 
not only from the standpoint of usefulness, but also be- 
cause they help the designer develop a "feel" for the 
physical situation. These methods, however, leave 
certain things to be desired. For example, if the 
system under consideration is a multi-loop affair, it 
becomes difficult and time-consuming to isolate the 
effects of varying an inner-loop parameter on the over- 
all behavior of the entire system. Systems of this 
type are frequently used to control the behavior of 
aircraft, which are, in themselves, dynamical systems 
of no mean order of complexity. 


In order to handle complex multi-loop systems 
some method is needed which rapidly determines the 
total transient response in such a way that the effects 
of varying any parameter are easily isolated and ob- 
served. Theoretically, it would be possible, say by 
hand computation of enough individual cases, to find 
an optimum combination of parameters. However, 
from the point of view of the time required to complete 
a design, this procedure is often outside practical 
consideration. The result is that a thorough analysis 
is not performed, and an extensive period of debugging 
the actual physical system is required. For this 


reason, it now becomes necessary to consider what 
can be done by automatic means of computation. This 
will be the general subject matter of this chapter, 


In the following section, the reasons for using 
machines in analysis will be discussed more thoroughly 
than has been done in the above cursory and purely 
introductory examination. The potentialities and limi- 
tations of these devices will be examined. Special 
attention will be given to problems which, to date, can 
be solved most practicably with computer techniques . 


It will be shown that there are only two types of 
devices suitable for such purposes at present; the 
analog, and the digital type of computer. The two 
types of computer (and variations within each type) 
will be discussed, primarily with a view to indicate 
which are best for control systems analysis and syn- 
thesis, and why they are best. 


During this discussion, it will become apparent that 
the operational amplifier type of analog computer ap- 
pears to be most useful for the applications considered 
here. The final section of this chapter will attempt to 
establish that this proposition is indeed true, and to 
say under what conditions, and for what type of prob- 
lems this superiority of the operational amplifier analog 
most manifests itself. 


In order to do this, it will be necessary to describe, 
in some detail, how the computer works. This section 
will therefore lay the groundwork for the following 
chapter, in which the properties and operation of the 
operational amplifier computer will be considered in 
detail. Section 3 of this chapter will thus be in some 
sense preliminary, but enough material will be given 
to form a firm basis for the discussion of the relative 
advantages of this type of computer over other kinds . 
Special attention will be given to such qualities as 
easy and rapid variation of basic parameters, ability 
to collect data in a form suited for immediate inspec- 
tion, and usefulness in simulation while using actual 
system components. 


SECTION 2 — NEED FOR MACHINE METHODS 


The dynamieal problems presented by the design of 
aircraft control systems are complex. They involve 
many degrees of freedom, and may contain a multiplic- 
ity of feedback loops. Some of these feedbacks are in- 
herent in the dynamics of the airframe itself; others are 


added, in the d-sign of the control system. 

Multiple-loop systems give rise to the most difficult 
problems in control systems design, primarily because 
of the difficulty of determining how a change in an inner 


yr 
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loop parameter affects the overall transient response of 
the entire system. An attempt is sometimes made to 
avoid the problem of determining these effects. For 
example,one part of the system may be overdesigned 
and forced to meet too atringent requirements in an 
effort to assure that unknewn requirements on inner 
loop parameters are met. 


The techniques previously discussed do not adequately 
meet the problem discussed above. The analytical 
methods roplace a complicated system by a single 
closed loop transfer function for the complete sub- 
syatem. This closed loop expreasion often contains 
the parameters of the components in complicated com- 
binations rather than ss individual and easily isolated 
quantities. When such expressions are then used as 
part of a dynamical relation, it becomes extremoly 
difficult to determine the effects due to any single 
parameter of a component in the inner loop. 





Figure VII-1. Illustrative Two-Loop Servomechanism 


For example, consider the system shown in figure VII-1; 
it is a fairly simple two-loop device. Its transfer 
function is; 


G,G.G 
OEY z 1+ a, aa ay 


It is evident from the form of this expression that even 
for this comparatively simple case it would not be 
easy to say anything about the effects of the individual 
parameters contained in G,, or H3, upon the behavior 
of the entire system.* In more involved multiple-loop 
systems, such as found in aircraft control systems, 
the determination of effects of inner loop parameter 
variation becomes an horrendous task and is frequently 
economically unfeasible. The technique of overdesign 
(which was discussed above) may be applied, and the 
efficient design of the entire controls system, as an 
integrated unit, is imperiled. 


To resolve this difficulty, some means of analysis is 
needed which will permit the effects of varying all 
parameters to be quickly and easily observed, no 
matter how the component bearing these parameters 
is interconnected with the rest of the system. 


It is not to be understood that the reasons discussed 
above are the only ones which indicate that it would be 
desirable to have a means by which parameter changes 
could be readily handled. The analysis of any complex 
system, with a number of adjustable parameters, would 
be greatly expedited by some such method. Even after 
a large amount of preliminary thinking has been done 
about suitable (and attainable) ranges of adjustable 
quantities, there may well remain a large amount of 
analysis to be dane before the most suitable combination 
of parameters can be selected. 


For these reasons it now becomes necessary to inves- 
tigate machine methods. The next section will discuss 
the various types of computer and the basic mode of 
operation for each. The final section will compare the 
types of computers and their relative usefulness in 
solving problems of the sort discussed in this section. 


SECTION 3 — AVAILABLE METHODS OF AUTOMATIC COMPUTATION 


Section 2 of this chapter has shown that a need exists 
for some automatic means of solving the equations of 
motion of complex systems. This section will consider 
two different ways in which this may be done by the use 
of automatic computation. The two types of computation 
considered are the analog and the digital methods. 


(a) DIGITAL COMPUTERS 


A digital computer is any device which solves mathe- 
matical problems by the numerical process of counting 
discrete quantities. The digital computer may be a 
device as simple as the ancient abacus or as com- 
plicated as the modern electronic giant "Whirlwind I," 
but the fundamental principles of operation are the same. 


The normal desk computing machine is another example 
of a digital computer. Since this is a relatively simple 
device, it will be used to illustrate, in somewhat more 
concrete form, the general principle of operation 
state” +e, . 


Suppose that it is required to draw a graph of the 
equation y=5x+10 An operator would choose discrete 
values of x, Say x,,X2,...X, and use the machine to 
multiply each x, by 5. The machine actually operates 
in the following way: 


The quantity one is added x, times, and then this sum 
is added five more times. In other words the machine 
has operated by counting the discrete quantity one, 5x, 
times. Another interesting property can be noted: The 
machine stored the sum of x, units so that the second 
operation of addition could take place later. 


After each x, was multiplied by 5, the operator would 


* To do so, of course, requires at least a knowledge of 
their effects upon the roots of the characteristic 
equation. Many of the methods previously developed 
are essentia)!v waysof getting thisinformation with- 
out actually f.ctoring that equation, but it is evi- 
dent from (VII-1) that these methods will not work 
here, because of the way in which G2, Hg (and hence 


their parameters) are involved. 
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write down the resulting product, and at some later time 
add 10 to obtain y,. In this operation, the operator 
stored the information 5x, so that the quantity 10 might 
be added at a later time. When all the y, were com- 
puted and tabulated, the graph y = f(x) could be drawn. 
The precision of the graph would depend on the maximum 
number of decimal places available in the machine, 
since this would determine the minimum possible 
interval between the x,. Obviously the graph could be 
made as accurate as desired, within the limits imposed 
by the available number of decimal places, by choosing 
sufficiently small intervals between the x,. 


The complete procedure and operation necessary to 
solve the problem could be outlined in the following 
way: 
1. Operator decided on some plan of action or "pro- 
gram." 
2. Operator fed some information into the machine. 
3. Machine operated on some information, and 
stored some information. 
4, Operator stored some information and fed some 
new information into the machine. 
5. Machine operated on new information and pro- 
duced answers that could be tabulated. 
6. Operator drew graph from tabulated information. 


Equations of the types considered in this volume could 
always be solved numerically if time were available; 
solutions to these equations might be obtained by using 
a desk computing machine, somewhat in the manner 
described above. This would, of course, be very time 
consuming. It is to overcome this objection that modern 
high speed digital computers have been built. In these 
machines, both numerical information and programming 
are introduced at the beginning of a problem. All 
required operations (including storage) then become 
completely automatic. Final answers generally are 
received in the form of tabulations or punched cards, 
but new methods have been developed to plot answers in 
graphical form also. 


Many techniques have been developed to speed up 
computation. Electronics has been used to replace 
mechanical parts. Counting systems other than decimal 
are frequently used. These details will not be discussed 
here, but are merely mentioned as matters of back- 
ground interest. 


(b) ANALOG COMPUTERS 


An analog computer is a physical system,the variables 
of which may be easily measured, controlled,or manip- 
ulated; it is used to study another physical system which 
does not have these desirable characteristics. In 
addition, the physical system represented by the analog 
computer must be governed by the same mathematical 
relationships as the system under study. 


The analog computer may be a device as simple as a 
slide rule in which a length along the rule is made 
proportional to the logarithm of the number concerned. 
On the other hand the analog computer may be as complex 
as the modern electronic computer whose electrical 
system is set up according to the mathematical relation- 
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ships of the system to be studied. 


There are many types of analog computers, but they 

all may be divided into two categories: 
1. Those devices in which the detailed structure of 
each component of the system under investigation is 
represented as its analog (e.g., a spring is made 
analogous to a condenser, a damper to a resistance) . 
2. Those devices which function by performing the 
mathematical operations indicated by the differential 
equations representing the systems to be studied. 


An example of the first type is a transient analyzer. 
This device might be set up to investigate the dynamics 
of a mechanical system which contains a mass, M, 
damping, B, and a spring constant, k , and is described 
by the differential equation: 


2 
VII-2 yy aox dx s 
¢C ) 02° Batt ** f(t) 


One set-up which might be used as analogous to this 
mechanical system is an electrical L, R, C series 
circuit excited by a voltage e(t) and which has as its 
equation 


: d7q,n299,1,. 
(VIT-3) ba Pato e(t) 


The mathematical form of the expressions in (VII-2) 
and (VII-3) is identical, provided that the inputs f(t) and 
e(t) depend upon the time, t , in the same way func- 
tionally. Thus the behavior of the electrical system can 
be studied, and the results applied to the performance 
of the mechanical system. 


The magnitude of the inductance may be made numeri- 
cally equal to the magnitude of the mass; the resistance, 
to the damping; and the inverse of the capacitance, to 
the spring constant. 


The second type of analog computer is one in which 
devices are used essentially to perform mathematical 
operations as such, rather than to mimic more directly 
the behavior of the system being represented. 


These computers are of the "differential analyzer" 
electromechanical type, using, for example, Kelvin 
ball-and-disk integrators, and of the "operational 
amplifier" type. These operational amplifiers perform 
the mathematical operations of addition, multiplication 
by constants, and integration with respect totime. In 
addition, special apparatus may be used for multi- 
plication of variables and the introduction of discontinuity 
type non-linearities. 


In this type of computer, variables are represented by 
voltages; parameters are adjusted by plug-in resistors, 
potentiometers, and capacitors, and results are easily 
recorded in graphic form by means of oscillographs. 


The previous example may be used to show how such a 
computer might be set up. Equation (VII-2) may be 
rewritten as: 


q’x , ~p ax - 
moa 7 H(t) BSE kx 


The computer might be set up as indicated in the sche- 
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matic of figure VII-2. 


Note that the only operations used are addition, multipli- 
cation by constants (including -1),or integration with 
respect to time. A voltage equal to f(t) is fed into the 
computer and x and its first two derivatives may be 
picked off as voltages or applied to a recorder for 
graphical representation. 


£(t) 





Amplifier 
used as 
an Adder 


In this example the computer is easily designed to 
operate in the same time scale as the physical system 
represented. The operational amplifier type analog 
computer can almost always be used on this one-to-one 
time relationship with physical systems such as servo- 
mechanisms. For the special cases where frequencies 
involved are too high or too low for satisfactory opera- 
tion, time scale changes may be easily made. 





Amplifiers used 
as Integrators 













Figure VII-2. Illustrative Analog Computer Setup 


SECTION 4 — EVALUATION OF MACHINE METHODS FOR CONTROL SYSTEM WORK 


The previous sections of this chapter have shown the 
need for machine methods and the types of computers 
available. This section will discuss the relative merits 
of analog and digital computers when used in control 
system work. The two types will be compared and 
contrasted so that some conclusion may be drawn re- 
garding the choice of computer type for specific appli- 
cations. 


The choice of type of computer will be dependent large- 
ly on the following items: 
1. Set-up time. 
2. Easy and rapid variation of parameters. 
3. Ability to collect data in a form suited for im- 
mediate inspection. 
4. Usefulness in simulation while connected to 
actual system components. 
5. Accuracy. 


(a) SET-UP TIME 


In the last section, it was shown that digital computer 
operation depended upon previous programming. In 
complex problems, of the type treated in aircraft 
control work, the preliminary programming may be- 
come a Herculean task. Recall the operations re- 
quired for the simple example given in the last section, 
and then consider the large programming necessary 
to solve a simple sixth order algebraic equation. 
This task is multiplied many times when one considers 
operations such as integration, differentiation and 
inputs such as sine waves, or irregular waves. 


Many digital computers are built as ''general purpose" 
machines; That is, they can be set-up to perform a 
wide variety of combinations of elementary operations 
necessary for the solution of various kinds of problems. 


vil-4 


These "general" computers have the advantage of 
being applicable to a very large number of types of 
problems, but a considerable price has to be paid for 
this flexibility. Because of it, extensive programming 
and a large set-up time becomes necessary to prepare 
the machine for the solution of specific problems. 
Digital computers have also been built for special 
purposes, but not all exigencies can be adequately 
covered by such "special purpose" machines, and 
even with "special purpose" machines, careful pro- 
gramming may be required. 


For those types of problems where the same cycle of 
operations is performed repetitively, the set-up time 
for a digital machine becomes a smaller proportion 
of the total time allotted for a task. Use of analog 
computers may also require careful planning. Certain 
precautions, important in any electrical circuitry, 
must be observed. Details such as impedance match- 
ing, voltage levels, and efficient use of amplifiers 
must be examined. These considerations are of con- 
siderably more importance in the physical structure type 
of analog computer than in the operational amplifier type . 


With both analog and digital:type computers, consider- 
able interconnecting must be done. The interconnecting 
must be checked,and this takes time. However, the 
wiring required in the analog computer is considerably 
less than that used in the digital type because of complex 
programming required by the latter. 


(b) VARIATION OF PARAMETERS 


It is not usua:|, easy to change the numerical values 
of parameters in digital computers. These machines 
may perform individual operations at extremely high 
speed. However, an entire computation may have to be 
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carried through one or two hundred times before the 
equivalent of one second time of operation of the device 
represented by equations is complete. In addition the 
results are usually presented in tabular or punch card 
form. For these two reasons — length of time and poor 
form of output data — it is difficult for an operator to 
evaluate quickly a result so that he may sensibly vary 
a parameter. 


In the physical structure type analog computer, each 
parameter is usually represented by easily identifiable 
individual or group resistors, capacitors, or inductors. 
These components may be varied within limits, but the 
problem of size (mentioned earlier) must be reckoned 
with. 


Parameters may usually be varied on the operational 
amplifier type by merely changing a plug-in resistor or 
the setting of a potentiometer. It will be shown later 
that all electrical analog computers present data in a 
form that makes evaluation simple and rapid. This 
is of great assistance to the operator who wants to make 
reasonable decisions when varying parameters. 


(c) FORM OF DATA 


The results of digital computers are usually presented 
in the form of punched cards or tabulation of numbers. 
As has been pointed out previously, it is difficult to 
visualize the behavior of a physical system from tables 
or punched cards. There are some new machines 
which convert the results into graphical form. How- 
ever, even with these machines it takes a relatively 
long period of time to plot the equivalent of one second 
operation of a physical system. 


The results obtained from analog computers are pre- 
sented in the form of voltages. It is a simple matter 
to connect any output of the computer to one of several 
types of recorders which automatically plot a variable 
against time. This, together with the fact that the 
analog computers can work in real time, makes the 
evaluation of the system under investigation simple 
and rapid. 


(d) SIMULATION 


It is frequently desirable to simulate operation of a 
complete system by combining actual physical sub- 
systems with the mathematical representation (com- 
puter operation) of the balance of the system. In this 
way, it becomes possible to avoid errors which might 
result from an attempt to represent the subsystem in 
purely mathematical form. In some cases the physical 
laws which govern the behavior of that subsystem 
have not been well worked out in mathematical form, or 
they are sufficiently complicated that reduction to 
suitable machine form might demand excessive time. 


Digital computers do not operate on a real time scale, 
in general, and also generally do not pit out signals in 
a form directly usable by the physical equipment; 
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therefore, it normally cannot be used for the purposes 
of simulation. The analog computer, and in particular 
the operational amplifier type, does work in real time 
and is admirably stited to simulation studies. 


(e) ACCURACY 


Theoretically, the results of digital computing may be 
made as precise as desired. The precision is limited 
only by the number of digits which the machine can 
hold in the various registers of its arithmetic unit 
and its memory or storage function. This limitation 
is mere severe than is apparent at first glance. Numer- 
ical errors caused by rounding off figures and trun- 
cating numerical series tend to cumulate statistically. 
For this reason, it may be necessary, for example, to 
carry a large number of significant figures in a com- 
putation in order to be assured that the result is correct 
to a relatively few significant figures. This sort of 
difficulty may be minimized by very careful planning 
and programming. 


The precision of analog computers is largely determined 
by the precision of the components within the computer . 
With careful planning, most analog computers can 
produce results accurate to within a few percent. 


It should be noted that in controls system work, the 
parameters of components of the control system are 
seldom known to better than about ten percent. In the 
case of certain aerodynamic quantities, uncertainties 
as much as + 50% are not uncommon. For these 
purposes extreme accuracy is not usually justified in 
automatic machines. 


For ‘those special cases where an investigation re- 
quires extreme accuracy only digital machines can 
be used at the present time. 


In conclusion, it may be stated, on the basis of the 
above considerations, that the operational amplifier 
type analog computer is generally the ‘best"' machine 
for use in control systems work. In special cases, 
the other types should be considered. 


It may not be inapposite here to look ahead somewhat 
to a possible future time at which a purely automatic 
com ination of digital and analog methods can be effected . 
Many problems will have to be solved to do this— such 
as design of high-speed digital-to-analog and analog- 
to-digital translators — before such a combination will 
become possible. In such a machine, the analog com- 
ponents would be used wherever their other advantages 
outweighed the need for precision. 


This prospect is, however, something very definitely 
in the future, and until this.means or others become 
practically realizable, the advantages of the analog 
type of computer for control system work will, in 
almost all caves, overbalance the higher accuracy of 
the digital computer. 
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CHAPTER VIII 
THE ANALOG COMPUTER 


SECTION 1 — INTRODUCTION 


In the preceding chapter, it was shown that the opera- 
tional amplifier analog computer is the moat valuable 
device now in existence for the machine solution of 
control systems dynamical problems. Theo present 
Chapter considers material relevant to the application 
of this type of automatic computation to such problems. 


The first section deals with B.C. amplifiers and ex- 
plains how they are used to perform certain mathemati- 
cal operations required for the solution of differential 
equations. In this section it is assumed that the ampli- 
fier is an ideal device. Hence, this discussion will be 
completely applicable only in those cases where the 
various approximations made in idealising the opera- 
tional amplifier introduce negligible error. 


The second section will consider real amplifiers (i.e. 
non-ideal) and show how and why the results obtained 
from such a real amplifier differ from the results 
obtained from an ideal amplifier. In particular, the 
effects of non-infinite gain in the amplifier, of drift, 
and of grid current will be discussed. 


The third section will consider in more detail the use 
of the operational amplifier as a summer, a sign 
changer, and ss an integrator. 


This will be followed by material related to the inter- 
connection and use of operational amplifiors in the 
solution of single and simultaneous linear differential 
equations with constant coefficients. 


In this part of the chapter, the manner in which a com- 


puter is set up for a representative set of suitable 
equations will be considered. This will include the 
determination of "gains," the selection of appropriate 
voltage levels, the computation of suitable resistor 
values and potentiometer settings, and the arrange- 
ment of the apparatus for maximum utilization of equip- 
ment and minimisation of the possibility of misbehavior . 


The concluding section of this chapter will then take 
up the important practical question of the representation 
in machine form of non-linearities. As pointed out in 
Chapter ILany real control system will contain non- 
linear offects such as backlash, Coulomb friction, and 
threshold and very often, excessive efforts may be made 
to minimise their effect because of ignorance of their 
influence on system behavior. Other non-linearities , 
such ss spring pre-loading or varying spring constants , 
may actually be built into a system in order to produce 
a dynamic effect which cannot be obtained by linear 
means. 


The means of representing threshold, acceleration, ve- 
locity, or displacement limitations, backlash, Coulomb 
friction, spring preload, and varying spring constants 
will be discussed. Certain limitations on the means 
of representing these offects will be pointed out. 


The non-linear problem is one in which computer opera- 
tion has a very great advantage over other methods for 
determining the response, since analytic solution of 
equations with non-linearities is inherently a tedious 
step-by-step process. The automatic computational 
methods seem to offer the only hopeful technique of doal- 
ing with these very important properties of the system. 


SECTION 2- "IDEAL" D.C. AMPLIFIER OPERATION 


This section discusses ways in which operational ampli- 
fiers may be used to perform certain mathematical 
processes used in the solution of differential equations 
These processes usually consist of algebraic addition, 
multiplication, integration, and differentiation. In the 
operational amplifier, these quantities are voltages 
which are analogous to the dependent variables of the 
differential equations written for the systems to be 
8 


In general, the operational amplifier consists of a 
high gain RC. voltage amplifier, an input impedance, 
and a feedback impedance. Figure VIII-1 illustrates 
the manner in which these elements are interconnected. 


The impedance, Z,, is added to this figure to represent 
the input grid resistor of the voltage amplifier. 


The overall gain of this amplifier may be found by 
writing the four equations (VIII-1) through (VITI-4), and 


(VIII-2) 0° 14Ze¢ , 
(VIII-3) e,* -Ke, ° 


° Operational amplifier design requirements necessi- 
tate an odd number of amplifier stages. Hence, the 
sinus sign. 
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Figure VIII-1. Qperational Amplifier 


(VIIT-4) e,° (1, ¢142)Z, 
solving for the ratio e,/e,. This overall gain, as 
found from these equations, is given by 


(VIII-5) % 2 1 
e 


Z le iis 2-H he) 


In this section, the amplifier will be considered an 
ideal device. As shown by equation (VHI-5), a very 
high gain M@ voltage amplifier will make the operational 
amplifier relatively independent of all quantities except 
the ratio of feedback impedance (Zr) to input impedance 
(Z,;) . An ideal operational amplifier then, would have 
a Be. voltage amplifier of infinite gain. For this ideal 
case, the relationship between the input voltage and the 
output voltage is given by equation (VIII-6); where the 
minus sign indicates a change in polarity. 


(VIII-6) en" -ot oy 
i 


The ratio -Z;/Z,; may be thought of as a multiplying 
factor or operator by which the input voltage is multi- 
plied to get the output voltage. In particular, if these 
two impedances are resistors, the input voltage will 
be multiplied by the ratio of these resistors, and will 
have its sign changed. The operation performed by 
the operational amplifier is that of multiplication by 
a constant and sign changing for this case, If the ratio 


is unity, the operational amplifier serves only as a 
sign changer. 


If the feedback impedance is a capacitive reactance, 
1.@.3 Z, » 1/(8C); and the input impedance is a resistance, 
the operator becomes 


ote ee 


Z R,Cs 


The relation between the input voltage and output voltage 
is given by equation (VIII-8). 


(VIII-7) 


(VIII-8) ®o" “RCs” 
The equivalent relation in the time domain is 


(VIII-9) e,° “at fe,at 


Vull-2 


For this case, the operation performed by the opera- 
tional amplifier is that of integration, sign changing, 
and multiplication by a constant (1/R,C). 


The operational amplifier may be made to differentiate 
by interchanging the resistance and capacitive reactance 
used above so that the relation between the input and 
Output voltages will be as given by equation (VIII-10). 


(VIII-10) e,° -R,Cae, 


The equivalent relation in the time domain is 


@,° RC MeL) 

dt 
In this case, the operational amplifier will multiply 
this derivative by R,C and change its sign. As will be 
pointed out in Section VII-3, the use of the operational 
amplifier as a differentiator may not be desirable 
because of the presence of noise. 


(VIII-11) 


If the feedback impedance of the operational amplifier 
consists of a parallel combination of resistance and 
capacitive reactance 80 that Zr =RrApC-8+ 1), the 
resulting relationship between the input voltage and the 
output voltage is given by equation (VIII-12). 


R 1 
6, ee Hd { ne 
R, (ater) “1 


In the time domain, this relation is given by equation 


(VII-13). 
i) 


For a unit step input, the output is a first-order lag 
as shown in (VIII-14). 


t 
@5(t) = - Fe (. 8 is) 
t 


Before discussing the process of addition with the 
operational amplifier, it is of importance to note that 
the grid voltage, e,, of the BW. voltage amplifier re- 
mains relatively unchanged while the input is varied; 
that is, as this grid voltage tends to change, the out- 
put voltage tends to oppose this change. To show that 
this is true, equations (VIII-1) through (VIII-4) are 
solved for the ratio of grid voltage to input voltage; 


(VIII-12) 


(VIII-13) 


(VIII-14) 


e@ 
(VIII-15) =e 


1 
e1 Ks (16 Be oh) 
8 ft 


It is apparent that, for gains approaching infinity, as 
does that of the ideal amplifier, the grid voltage re- 
mains at zero, 


Figure VIII-2 illustrates the manner in which the ele- 
ments are interconnected to perform the process of 
addition. The sum of the currents flowing into point 
A must equal the sum of the currents flowing out of 
pointa ;: 
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The grid current is assumed soro in the voltage am- 
plifier and does not enter into equation (VIII-16). As 
shown in the preceding paragraph, the grid voltage is 
sero in the ideal operational amplifier. Equation (VIII- 


Suma 


Z Z Z 
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Figure VIII-2, Addition 
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16) then takes the form of (VIII-17) 
©, @ e@ a 
tif. e > of 
aera an ae ae 
which, when rearranged can be written in the form 
--| 26,2 
[te Beaks) 


From this latter equation it can be seen that the out~ut 
of the operational amplifi~r is the sum of the inv ats 
multiplied by their respective operators. Though only 
threo inputs were consic-red above, any number can 
be used. The operation of integration or differentiation, 
multiplication by constants, and summing can be com- 
bined in a single operational amplifier. 


(VIII-18) 


In this section, it has been shown how the operational 
amplifier may be used to perform certain mathematical 
processes needed for the solution of linear differential 
equations with constant coefficients. The manner in 
which non-linearities may be included with the r- 
ational amplifier will be discussed in Section of 
this chapter. 


SECTION 3 ~ NON-IDEAL OPERATIONAL AMPLIFIERS 


In Section VIII-2 it was shown how the operational 
amplifier, if ideal, could be used to perform certain 
mathematical operations. Actually, the operational 
amplifier is not ideal. The DC. voltage amplifier does 
not have infinite gain, and is subject to "drift," grid 
current, electrical noise, and limiting. In addition 
to these undesirable characteristics in the DC voltage 
amplifier, the other components which make up the 
operational amplifier may not have the properties 
assumed. In this section the effect of these non-ideal 
properties on the operations performed will be dis- 
cussed qualitatively. Quantitative material will be 
developed in Section VII-4. 


The D.C. voltage amplifiers used in electronic analog 
computers usually have voltage gains ranging in the 
order of 6, 000 to 100,000. As is apparent from equation 
(VIII-8), the fact that the gain is not infinite puts certain 
restrictions upon the permissible values of input and 
feedback impedances. These restrictions will be 
further discussed in Section VIII-4. 


When the input to a high gain and properly balanced 
DC. voltage amplifier is zero the output should also be 
at zero potential. However, there may be small current 
changes (drifts) in the tubes. These drifts may be 
caused by slow changes in D.C. supply potentials, in 
cathode emission due to filament supply changes, and 
in the resistance of resistors due to changes in the 
ambient temperature. When these current changes 
occur in the first tube of the O.C.voltage amplifier, their 
effect will be multiplied by the gain of the amplifier 
with a resulting large change in the output. When such 
an amplifier is used as a computer, the output signal 
will then have this drift voltage added to that calculated 
for the ideal operational amplifier. 


The DC voltage amplifiers in operational amplifiers are 
used in what is termed "class A operation)'s that is, 
the grid is always negative with respect to the cathode. 


When the grid is negative with respect to the cathode, 
a current flows away from the grid terminal, as shown 
in figure VII-3. This current is of the order of micro- 
amperes; but, when flowing through a sufficiently high 
impedance, it may cause an appreciable voltage drop 
across that impedance. As was shown in the previous 
section, the input grid voltage of the operational am- 
plifier is effectively at zero potential for any reasonably 
large gain in the D4. voltage amplifier. For this reason, 
the grid impedance is not shown in figure VIII-3. 





Figure VIII-3, Qperational Amplifier with 
Grid Current 


In figure VIII-3, the sum of the currents entering 
point A must be gero as shown by equation (VIII-19). 


@ e 
oe 

This equation, when solved for the output voltage, 
becomes 


(VIII-19) 


(VIII-20) e@,°° ( z e° 1,24 


Equation (VIII-20) shows that the output voltage consists 
of the component which would be obtained from an ideal 
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operational amplifier, plus an additional component 
determined by the magnitude of the grid current and 
the feedback impedance. 


Generally speaking, noise may be defined as any un- 
desirable voltage which may appear with the desired 
voltage. The average value of the noise has been 
discussed in connection with drift and grid current. 
In the following discussion, noise will refer to that 
componern which has a zero average value. The sources 
of noise are many. Within the B.C. voltage amplifier, 
the two primary sources of noise are that generated 
in resistors when currents are flowing through them, 
and the thermal noise generated within the vacuum 
tubes due to the uneven "boiling off" of the electrons 
from the cathodes. Of greater importance is, perhaps, 
the noise due to "pickup." The wires used to inter- 
connect the operational amplifiers cannot be completely 
Shielded, and will pick up stray fields radiated by 
other components used in the analog computer. The 
presence of noise in these computers limits the lowest 
permissible voltage which can be operated upon by the 
operational amplifiers without having the noise appear 
as an appreciable part of the final result. 


It was mentioned in the previous section that differ- 
entiation with the operational amplifier may not be 
recommended due to the presence of noise. If the 
noise voltage has small rise and decay times, as do 
the thermal and resistor types, the operational ampli- 
fier connected as a differentiator will differentiate 
these voltages. If the input voltage is varying slowly, 
it is easy to see that the output signal may become 
largely noise. In addition the differentiated noise 
amplitude may become so great that amplifiers over- 
load. 


The D.C voltaye amplifier used in the operational ampli- 
fier is limited to a maximum voltage which can be ob- 
tained at the output. Above this value, the output stage 
saturates. To help eliminate the possibility of un- 
knowingly exceeding the linear operation range of the 
amplifiers, most electronic analog computers make 
use of indicators which signal when limiting occurs. 


AS was pointed out in the previous section, the oper- 
ation performed by the operational amplifier depends 
primarily upon the input and feedback impedances, 
The operational amplifier may be considered as non- 
ideal in the sense that these impedances may not be 
as assumed. While the values of resistors and con- 
densers used for these impedances are stated, the 
fact that they may differ by whatever tolerance has 
been assigned must be kept in mind. In addition to 
the values, it is of importance to know if the com- 
ponents are effectively pure; that is, if a resistor 
contains only resistance and a capacitor only capacitive 
reactance. At the frequencies used in analog computers 
the inductive effects of resistors are negligible and need 
not be cansidered. Capacitors, however, have a certain 
amount of leakage through them so that an accurate 
representation of a capacitor would show a resistor in 
parallel to represent the leakage. To reduce this 
leakage to a negligible value, highest quality condensers 


vir 


are used in the better analog computers. 


As will be shown in Section 3, the gains used in the 
Operational amplifier may correspond to the coefficients 
of the differential equation being analyzed. Since there 
is an infinite number of possible coefficients, an infinite 
number of possible gains could be required. It is not 
practical to obtain these gain variations by varying the 
feedback impedance, since when integrating, this would 
mean a very large variable capacitor would have to be 
employed. For the same reason it is not very practical 
to vary the input impedance appreciably. Furthermore, 
if small values of input impedance were required, the 
sources of input voltage would be excessively loaded. 


To make possible the desired gain variations without 
varying the input and feedback impedances, electronic 
analog computers have provisions for inserting a po- 
tentiometer in the input of the operational amplifier 
as shown in figure VHI-4. 





Figure VIII-4, Qoerational Amplifier with 
Potentiometer 


In effect,the potentiometer may be considered as an 
amplifier with a gain variable from zero to unity. AS8s 
may be noted in the figure, the fact that the grid voltage 
is always near zero effectively places the input impe- 
dance across the potentiometer as illustrated in figure 
VIU-5. 





Figure VIII-5. Equivalent Circuit 


If K’R, is that fraction of the potentiometer R, across Z;; 
the overall gain (e;/es) is 


(VIII-21) SL = K ; 
e, R, 
K/ 1-4 +1 
21 \ 


From this expression, it is apparent that the gain ahead 
of the operational amplifier is the fraction, «, of 
potentiometer setting only when the input impedance 
is much larger than the potentiometer resistance, 
Equation (VI1.-21) may be used to construct a family 
of curves relating the fractional potentiometer setting 
to the actual potentiometer gain for various values 
of input resistances. 


ry 


o—* a C | a | 
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ellipse with semi-axes a and. Figure VI-27 il- 
lustrates the phase plane plot of equation (VI-19) for 
various values of h. 





2 
System Equation: re | *+kx=0 


2 2 
Equation of Trajectories: aya ve = 1 


Figure VI-27. Phase Plane; Undamped 
Second Order System 


If viscous damping is added to the mechanical system 
described by (VI-17), the differential equation of motion 
becomes (VI-20) or (VI-21). 


2 
vI- “x. p93 +kx = 0 
(VE-20) ta dt 


la, * b ‘ oe & 


2 2 
(VI-21) eM 2, « a,x 0 


By making the substitution (dx/dt)- y, (VI-21) may be 
written in the form 


(V1-22) WS tuys wrx = 0 


If equation (VI-22) is divided through by y and re- 
arranged, (VI-23) results, 


2 
e dy eo -(= a od = 
(VI-23) = a 


in terms of the two variables x and y alone. Equation 
(VI-23) may be integrated to the form of (VI-24), 


(VI-24) 
Bont ag s Wetene 
y?+ awry + 2 x2= cela teat aE ) ; we o,f i- 03 


but this expression is not easily used. To express the 
equation in a more usable form, a change of variables 
such a8 ue wx and v=y-+ (#,x may be made, 30 that 
the equation may be written as (VI-25) 


(10-28) he Poca ttt) 
whteh, is polar form, becomes (VI-24). 
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tony 
(VI -26) p= Ce" 


Equation (VI-26) is that of a logarithmic spiral in the 
u-v plane and may be of the form illustrated in figure 
VI-28., | 
When discontinuities are introduced into the phase 
plane, more than one equation is needed to describe 
the motions of a system completely. A transformation 
of variables is not always possible when more than 
one equation is involved, without increasing the diffi- 
culty in interpreting the results. Therefore, it is 
often desirable to obtain the path or trajectory of the 
position and velocity on the phase plane using the 
original coordinate system. To obtain the trajectories 
given by equation (VI-24) without actually solving the 
the equation, the method of isoclines can be used. 
In equation (VI-23) it may be noted that the slope (dy/dx) 
of the trajectory in the phase plane depends only upon 
the values of x and y. It may be further noted that in 
this equation the slope is constant for any particular 
ratio of x to y. For this particular example then, 
Straight lines may be drawn in the phase plane corres- 
ponding to different ratios of x to y. If any trajectory 
intersects these lines, it must do so with the slope 
defined by equation (VI-23). In general, equations of 
the form of (VI-23) may always be used to obtain the 
curves through which the trajectories must pass with 
a particular slope. These curves are referred to as 
"isoclines." If a sufficient number of isoclines are 
drawn in a phase plane, a trajectory may be drawn by 
intersecting each isocline with the appropriate slope. 





2 
System Equation: a +b os *kx= O 


bk ; 
Equation of Trajectories: p =C,e-*4 ¥ 
Where: u-= pcos ¥, v=o. sin 


Figure VI-28. Phase Plane; Second Order System with 
Damping Ratio <1 


In figure VI-29 the isoclines are drawn as straight 
lines through the origin. The slopes, as determined 
frem equation (VI-23), are drawa as short dashes 


theengh the ieceeaes to act as guides in drawing the 
tenfesterp frem seme Gsttgnh eunditien. 
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The direction traveled by a point in a trajectory is 
found from the original equations. Consider, for 
example, the fourth quadrant of figure VI-29. In this 
quadrant, y is negative so that (dx/dt)is also negative; 
and from equation (VI-22), (dy/dt) © -(+2fany « a2x), 80 
that for w?x>2{fay , (dy/dt) is also negative. If the 
other quadrants are similarly checked, the direction 
of travel on the phase plane will be found as indicated. 






Isoclines 


Ra ON 
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System Equat ion: 4 ° Ata ¢kx=0 


d 
Slope of Trajectories: dy (ee) 
dx a y 


Figure VI-29. Phase Plane; Second Order System with 
Damping Ratio <1 


The simple linear systems described above serve to 
illustrate some of the techniques used with the phase 
plane representation. Now, to include a discontinuity, 
the spring constant term of equation (VI-17) will be 
changed to represent a preloaded spring. This changes 
the equation to the form m(d2x/dt2)+¢(kx + f,sgnx) «0 . 


This relation may be expressed by the pair of equations 
2 
vi. kxef,=0 for x>0 
(VI-27) wm LH ekxet, 
a CX sKx-1,=0 for x<0 
dt 


where f, is the amount by which the spring is pre- 
loaded. Let k= ma? and f,-ame* , equations (VI-27) 
may be written in the form 


(VI-28) i + wxe au?» 0 for x>0 


2 
d°x ¢ wW3X- aw2 «= O for x<®@ 
dt? 


If new choices of origin are taken such that x, > x 8 for 
x>0 and x,-x-a for x<0, equations (VI-28) may be 
written, after integration, as 


2 2 
y x 
VI- a > 
(VI-29) on’ vit 1 for x>0 


2 a 
¥2,_ %3 


2h 2h/,,2 


=] for x<0 





(VI-30) 


where h is a constant of integration. | 


This system is represented in the phase plane by 
pairs of ellipses with origins displaced from x«0 by 
za onthe x axis. As a point on the trajectory passes 
from the left half plane into the right half plane, 
the trajectory changes from the ellipse at origin 
xe+a to the ellipse at origin x=-a. Figure VI-30 
shows the trajectories for four initial conditions. 
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System Equation: am qx. kx = -f, Sgn x 


dt 
» -f, For x>0o 


« ¢f, For x<0 


2 2 
. ty fal a For x? 0 
Equations of Trajectories oh ¢ oni? 1 


y," x2 


2 
+ « 1 Por x<o 
ah 2h/,; 2 
Where X,7X*R, XQox-a 


Figure VI-30. Phase Plane; Second Order with 
Spring Preload 


As illustrated by the simple undamped system with a 
preloaded spring, the inclusion of discontinuities in 
the phase plane representation of systems may be 
Simply achieved. The labor of determining the initial 
conditions at the points of discontinuity is eliminated. 
since the velocity and position are always available 
for all points in the plane including points of discon- 
tinuity. 


The remainder of this section will present several 
examples of simple systems containing discontinuities 
to further illustrate the phase plane method. 


COULOMB FRICTION. The effects of coulomb friction 
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Figure A-1. Typical Response Curves of Second Order System to Step Function Disturbance 
When Damping Ratio is Less than Critical (( 21) 
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8+, 
82+ 1.40,8 +05! 
s? + 1, 750,87 + 2, 150,28 + 0,3 
84+ 2, lugs? + 3, 40,28? + 2, 70,28 + Wo! 
8° + 2,808 + 5. OW, 28? + 5. Sup 282 + 3. 4948 + Wo” 

8° + 3, 250,8° + 6. 60W5284 + 8, 60W_28? + 7, 45482 + 3, 9Buy 5B + Wo & 
87 + 4. 4898" + 10. 420.285 + 15, 08uy 98% + 15. 5409 ‘8? + 10, 64 ®B* + 4, 58g “B+ Wo" 
8° + 5. DuB7 + 12. 80u, 28° + 21. 600, 28° + 25, 159 *B* + 22, Duy "s? + 13, Ww, 652 45, 150.8 + Wo" 


Table A-5. 
The Minimum itae Standard Forms Zero-Displacement-Error Systema 


87+ 3, 20,8 + w, 4 
87+ 1. 750,87 + 3, 25u, 28+ w, 
a* + 2, 410,87 + 4.930, 28? + 5. 140, 28 + w, § 
s® + 2, 19w,8 + 6, S0u, 287+ 6, 300, *s87 + 5, 240, f+ w,® 
8° + 6: 12u,85 + 6. 710, 284 + 8. 580,28? + 7.07, 48? + 6. 760, 98 + w, © 


Table A-6. 
The Hinimum itae Standard Forms Zero-Velocity-Error Systems 


87+ 2,970,872 + 4. 94, 28+ w, ° 
Bt + 3. 710,8? +7. 880, 2s? + 5.93u, %s + w, * 
s+ 3,810.84 + 9. 940, 289+ 13, 440, 983+ 7, 36u, 45+ w,° 
8*+ 3.930,8°+ 11. 68u, 284 + 18, 560, 987+ 19, 300, ‘82+ 8.060, %s + w,° 


Table A-7. 
The Minimum itae Standard Forms Zero-Acceleration-Error Systems 


B+, 
87+ Ww,8 + 0,2 
8? + 30,87 + 30,28 + w,? 
| ‘+ 40,8? + 6u,287+ 4u,%8 + w,4 
8° + 60,84 + 100,787 + 10, %s? + Su, ‘s+ w,° 
8° + 6u,8° + 15,284 + 200, 287+ 150, ‘8? + 60,%8+ w,° 
a7 + 7u,8* + 214,285 + 350,284 + 35u, “8? + 210, 587+ TH, %8 + w,! 
a + 80,87 + 280, 28° + 56u, 28° + 70u, ‘84 + Bw, 58? + 280, °B? + Bu, "8 + w,° 
Table A-8. 
The Binomial Standard Forms 
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Figure A-8. Response of a Second Order Accelerameter to Sinusoidal 
Acceleration Input 
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Figure A-11, Response of a Second Order Accelerometer to Sinusoidal 
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Decibel Values 
Figure A-20. Linear Magnitudes vs. Decibel Values 
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From equation (A VII-5), 


1 
5(-t) = = fren sot dw « ssc dw 


(A VIII-6) 
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where « is replaced by <w. Therefore, 


d(-t) = &(t) 


SECTION A IX - MEMORY FUNCTIONS 


In Chapter II, Section $d, it was shown that transfer 
functions completely define the performance of asystem 
in terms of the Laplace transform complex variable s. 
Memory functions (sometimes called weighting functions) 
provide a complete characterization of system perform- 
ance in terms of the real time variable, t. This section 
discusses two interpretations of memory functions and 
also derives a necessary condition that they must satisfy 
to represent stable systems. | 
1. One method of describing the memory function 
is to relate it to the system transfer function. If K (8) 
is the transfer function of a system, the memory 
function, W(t) , is defined as 


(A IX-1) W(t) » oS" K(wye!@* dw 


The Fourier transform of ¥(t) ts 


(A IX-2) K(w) © fructye sot dt 


K(w) , the Fourier transform of the memory function, 
is merely the transfer function with s replaced by Je, 
Equations (A [X-1) and(A [X-2) demonstrate that K(w) 
and W(t) are a Fourier transform pair. 


2. The memory function can also be related to the 
response of a system to a unit impulse (or delta 
function) input. 


The output of a system may be defined by the equation 


(A IX-3) C(w) » K(w)R(o) 


where R(w) and C(w) are the Fourier transforms of 
the input and output, respectively, and K(w) is the 
transfer function with s replaced by Jv. Let the input 
r(t) = &(t) . Then 


R(w) = f b(t)e"“t dt = 1 


by (A VIII-4). Substituting in (A IX-$), 
(A I1X-4) C(w) = K(w) 
Taking the inverse Fourier transform of (A IX-4), 


(A IX-5) C(t) = W(t) 


(A IX-8) states that the memory function may be 
thought of as the response of a system to a unit im- 
pulse input. 


3. For a stable system, it is necessary that 


(A 1X-6) Wt) = 0 for t<0 


Equation(A IX-6) is demonstrated below by integrating 

the Fourier integral representation of the memory 

rer aes a contour in the complex plane. From 
A IX-1), 


./* wt 
or 


W(t) sah, K(o)edt d(jw) 


Consider a similar integral, I, where the variable of 
integration is the complex variable p: 


9 pt 
I aaj { K(p)e®* dp 


and the path of integration along the contour C is shown 
in figure A [X-1 below: 





Figure A IX-1. 


Complex p-Plane 


Since the contour, C , is composed of two portions, I 
can be expressed as I+ I,+I, 


where 
i aeceees pt 
I, J lia K(p)e?* dp 
and 
K(pye™* dp 
fa ay senicircle 


IfR is permitted to approach infinity, 1, becomes 
w(t) or 


(A IX-7) w(t) = lim r- lim T, 


If K(p) describes a stable system, there are no poles 
in the right half p-plane, and 
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(A IX-8) jis I< 0 


If K (p) corresponds to a physically realizable system, 
its denominator must beof higher degree than its numer- 
ator so that K(p)-0 as |p| = R-@. Let the difference 
in the degrees of the numerator and denominator be &. 
Then for large R8, K(p) will behave like 1/p", and 
I, will act like 


1 tat dp 


I, % D 
' an j eenicirole 


Letting p* Re!” along this contour, 


1 1 jo 
I, rs] s qaenté gate jre)® ds 





or 
1 . jo 
Isz- roe e eia( iam) gate’? an 
Then 
1 « Je 
Ital s [amtera] (10! || att"? ae 
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This is true since, in general, |ef*)| « of!{#(s)) 
where Ri(f(z)] denotes the real part of f(z), and 
also since |e/4(!°")| . 1, 


Letting & get indefinitely large, for all negative values 
of t, Jia [t,] = 0 for every integer m>0. 


~ |1,| 20 since it is the absolute value of a quantity, 


jim |1,| 20 
Therefore 
(A IX%-9) Jia I1,| o lim I, 20 


Substituting equations (A [X-8) and (A IX-9) into equation 
(A IX-7) gives 


wt) = 0 for t<0 


ry 


i) 


| Coy FoR COP FOP FY 


at 7 = 5 


- 


i 


a nae i; ' 


am 


Fe aes) 





(xe a)(xebD)xe ce 0 
4 (xeay(xs b)x = -1 


See figure A V-2. 





Figure A V-2.((x+A)x+B)x+c = 0 © (xed)(xoe)(x+ f) 


Finally, the factors (x +d), (x +e), and (x + f) are 
substituted into equation (A V-1) and the new equation 
solved; 


(xe d)(x+¢ e)(x¢ f)x+D= 0 
Bt d)(x+e)(x¢f)x = -] 


APPENDIX 
Section A VI 


See figure A V-S. 


Evidently, this procedure can be used to solve for 
the roots of any rational polynomial with constant 
coefficients. Since the essence of the method is to 
reduce the polynomial to a series of equations of the 
form 1+ f(x) « 0, any of the methods discussed in 
Chapter III may be used to handle it. In particular 
the open loop closed loop method yields a fast approxi- 
mation to the roots that can be of great value. (See 
Section IlI-$3. ) 





Figure A V-3. {((x+A)x¢ B)x eC}x+D « x4eAx I ¢ Bx? 
+Cx+Da 0» (xsa(x+BNxey)(x 48) 


SECTION A VI - FOURIER TRANSFORMS 


The use of the Laplace transformation has become 
commonplace among control system designers. There 
are several other transformations which are particularly 
useful for special applications, but which are less 
familiar to control system designers. This section 
presents some background for the Fourier transfor- 
mation which is used extensively in the theories of 
optimum synthesis discussed in Chapter V. 


Let g(t) be a periodic function with the period T de- 
fined in the interval -(T/2) < t < (1/2), where g(t) is 


defined at finite discontinuities. Then g(t) can be 
expanded in a Fourier series of the form 


g(t) = 3. mm oft 
where 
i + - jant 
&, ry, g(t) e dt 


As the period is allowed to grow indefinitely large, it 
can be shown® that s(t) can be expanded as 


(A VI-1) g(t) e f° givt dw f g(t) e" Jer dt 
This is the Fourier Integral theorem. 
From (A VI-1), if 


* ‘Pourier Series and Boundary Value Problems,’ by 
R.V. Churchill, McGraw-Hill Book Co., New York, 
1941. 


(A VI-2) Bw) « f- g(tye"!t dt 
then 

1 © jot 
(A VI-3) g(t) = on. de B(wye dt 


The last two equations are called Fourier transform 
pairs. 


If B(w) is an evenfunction [B(w) = B(-w)) , thetrans- 
form pair may be somewhat simplified. Expanding 
equation (A VI-8), 


1 « j 
g(t) « ale B(w)coswt dw rn B(w)sinwt dw 


The second integral is zero since the integrand, B(w) 
sin wt, is an odd function and the integration is over a 
symmetric interval. Also, since the integrand of the 
first integral is even, g(t) can be expressed as 


(AVI-4) g(t) «= B(w)coswt dw 


g(t) .sanevenfu on since if t is replaced by -t 
in equation (A VI-4,;, the right side remains the same. 
Starting with equation (A VI-2) and proceeding in a 
manner similar to the development of equation (A VI-4), 
it can be shown that: 


(A VI-5) B(w) = 2 J g(t) cos wt dw 


Equations (A VI-4) and (A VI-5) are called Fourier 
cosine transform pairs. 
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SECTION A VII - THE PARSEVAL RELATION 


Analyses which apply Fourier transforms frequently 
make use of the Parseval relation. This.section states 
the theorem and proves it. 


The Parseval relation states that 


(A VII-1) f |B(w) |? dw = anf [e(t)|2dt . 


where B(w) and s(t) are Fourier transform pairs. 
Proof 

f” [B(w)[*de = f° Ble) Be(s) do where the asterisk 
indicates the complex conjugate. By definition 


B(w) = f  g(tyeJt dt 


(A VII-2) 


If g(t) is a real function of time, 


(A VII-3) B*(w) « f g(tyei“t dt = B(-w) 


80 
f° [Bcw)|? do = f° B(w) B(-0) du 


From equation (A VII-3), 


f° [Buy |"ae = f"B(-wydu ({a(tye!* at] 


Interchanging the order of integration, 


(A VII-4) 
["[p(wy|?do = {2dt( ect) Lf B(-we" °F do} } 


But 
(A VII-S) fBc-wye" 5+" dw = f-B(wyet* de 


where w is replaced by -» . 
By definition 


(A VII-6) g(t) » — ["Bcuye!t de 


When equations (A VII-§) and (A VII-6) are substituted 
into equation (A VII-4), 


f"|Bcwy[" du = an frat(acty(e(ty)) 
but since g(t) is a real function, 


Cecty)? = lectyl” 
and 


(A VII-7) S718? de = ans | g(t) | 2at 


SECTION A VIII - DELTA FUNCTIONS 


The Delta Function is one which is characterized by 
some unique properties. Its use obviates the necessity 
for using some highly abstract and complex mathematical 
techniques. This section discusses some properties 
of the 8-function which are relevant to the development 
in Section 4 of Chapter V. 


The delta function, 5(t) , is defined by the following 
properties: 


(A VIII-1) a) 8 (t-t,) = 0 tf t, 
by (t- ty)dt = frdctyat = 3 


Other useful properties of the 5-function may be derived 
from the original definition (A VII-1). 


The "sifting property" is expressed mathematically in 
equation (A VII-2): 


(A VIII-2)  f'£(t) B(t- tydt = £(t,) 


Tr’ 1ression may be derived as follows: 


(A VIII-3) 
SP £(ty 8 (t- ty)ax - (eens f(t) &(t- t,)dt 
where ¢ is arbitrarily close to zero. Equation (A VII-S) 


follows from (A VIII-1a); that is, the integrand is identi- 
cally zero for t # t,. Using the mean value theorem, 


t +e 
i 


ott 


£(t)3(t-t,)dt « (eS, * act-typat 


= £(E)f- B(t-tp)dt = £(6) 


where (t,.- €&) <& ¢ (tot €). But since « can be taken 
arbitrarily close to zero, it must follow that & = ¢,. So 


s'1cty 5 (t- t,ydt © £(t,) 


Using the sifting property, the Fourier transform of 
the 5-function is found to be 


(A VIII-4) —f"B(tye" IF dt = em JHCO) sy 


and the inverse Fourier transform of unity is 
1 jut e 
(A WIII-5) sxtel eet dy = 8(t) 


6° ¢,+¢,. If one of the points lies inside C, w goes 
one complete time around the origin. Similarly, for 
m points inside the contour C, w goes through 37a 
radians around the origin; i.e., it encircles the 
origin a complete times, rotating in the same direc- 
tion as gs. 


The extended theorem can now be stated: When 
a closed contour is mapped through a function 
we (= C,) (B= C,)...(8-C,) where all C’s lie inside 
the contour, then as zs travels completely around 
Cc, w travels around the origin a times and in the 
same direction. 


There is no restriction on the location of ©,. and ©,, 
as long as they are inside the contour C,. Thus, ©, may 
coincide with ©, giving w= (s- 0,)*®: the rule still re- 
mains the same. 


MAPPING A CONTOUR THROUGH THE FUNCTION 
we 1/z . It will be shown that when the contour © is 
mapped through this function, the resulting contour C’ is 
no longer geometrically similar to C but is generally, 
distorted into quite a different shape. This transfor- 
mation still transforms circles into circles, but straight 
lines become either circles or straight lines, depending 
on their position in the s-plane. 


Using the polar form, one writes: 


Ze re!9. We pele i. i,°56 
(A IV-6) z fF 


“pe 4 ; oe 6 


These relations explain the reason for the distortion 
of the contour: each vector r turns into its own re- 
ciprocal, 1/r; thus, points far away from the origin 
come quite near, and vice versa. Moreover, each 
angle 0 turns into its negative, -9. Thus, the contour 
is reflected across the x-axis; 1.e., points of C lying 
in the upper half-plane become points in C’ lying in 
the lower half-plane (see figure A IV-16), 


sy | 


(-Jv) 





Figure A IV-16. Mapping; we 1/s 


Figure A IV-16 shows the mapping of a single point, 
Cy into the w-plane. It also shows the unit circle, 
rel. f> is shown to be about 2 units; ©, is 1/re 1/2 
unit. The final image, Ci, , is the conjugate of C’, . 
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Figure A IV-17 shows the image of the circle r = 2. 


This image is a circle of radius p+ 1/2 a point z moving 
along the contour C'from Ato B moves clockwise; the 
corresponding point w moving from A’ to 8" moves 

. It is important to note that this is 
the opposite of the behavior of the transformations 
discussed before. 





Figure A IV-17. Mapping; we i/s 


The “encirclement” theorem can now be extended 
once more. Let 
1 J¢. 
we a 007% waz-C, 2, eft 
(A IV-7) Z- Go ea 
we oe err 
 W 7 p @ J¢, 


Examination of w-z-C, (C, inside contour C0) shows 
that, as z moves around C in a clockwise direction 
Once, ww circles the origin once, also in a clock- 
wise direction. And since w= 1/p,e°/%1, it follows 
that, as w, circles the origin once in a clockwise 
direction, w circles its origin once in a counterclock- 
wise direction. By analogy one may infer that for 


perm eeeereeree 
oe "* Ta-C,)(z- Cy) 


when C, and C, lie inside the contour C,then, as xz 

travels around C once in a clockwise direction, w ro- 
tates through 2712 radians around its origin, but in the 
counterclockwise direction. Once more, if C; coincides 
with C,, we 1/(2- C,); the rule still remains the same. 


MAPPING THEOREM UNDERLYING NYQUIST CRITER- 
ION OF STABILITY. The above theory is sufficient to 
prove an important theorem used in servomechaniam 
work, 
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It will be recalled (see section A III, Functions of 
Complex Variable ) that a transfer function can be 
of the form 





w(z) rd] N(2) s 


(A IV-9) aes 





BG) (Bag)... (2-a,) 


Q,.M,....a, are the seros of w(z); a,,a5,...a,are its 
poles. 


If there are multiple roots of N(z) or of D(s), this 
expression may become: 


_ (ze 0) 8 (ne ay)... (ee ay) 
(erat) :-0(8) (2 1) "(Z- Og)... (Z= Op) 


Let there be a contour C in the z -plane and let all 
the zeros and poles of wiz) lie inside this contour ; 
let C be mapped into the w-plane through the function 
wz) shown in (A IV-10). It will at once be seen, 
as a consequence of the above "encirclement" theorem, 
that as z travels around C once, in a clockwise direc- 
tion, the point w traveling on its image c’, will circle 
the origin of the w-plane in the same direction as many 
times as there are roots a, (i.e., zeros) and in the 


opposite direction as many times as there are roots 
a, (i.e., poles). If there are Z zeros and P poles 
lying inside C, then, calling the number of encircle- 
ments of the origin of the w-plane, in the same direc- 
tion as that of Z, N, this theorem states that: 

(A IV-11) N= Z-P 

Defining the counterclockwise direction as positive, 
(A IV-11) can be expressed in words as follows: “If 
the contour C encircles Z gseros and P poles in a positive 
sense, the contour C encircles the origin N= Z-e times 
in a positive sense." 


In servo work w(2) usually is of the form w(3) -1+ Y(z). 
It is more convenient to work with Y(z) and thus the 
Y (z)-plane. Since Y¥(z) «w(z)-1, any point in the 
w(z) -plane maps into the same point shifted to the 
left by one unit in the Y(z) -plane. Thus the origin 
of the w(s)-plane becomes the-1 point of the = Y (s) 
-plane and the mapping theorem may be restated. 


"If the contour c encircles Z zeros and P poles ina 
positive sense, the contour C’. encircles the -1 point 
N=» Z-P times in a positive sense.” 


SECTION A V — FACTORING POLYNOMIALS BY SERVO ANALYSIS METHODS 


SECTION AV - FACTORING POLYNOMIALS BY SERVO 
ANALYSIS METHODS 


Any of the servo analysis methods developed in Chapter 
III can be used to find the roots of equations to varying 
degrees of approximation. This is accomplished by 
rearranging polynomials to obtain a succession of 
equations of the form 1+ f(x) » 0 and applying the special 
methods developed in that chapter for finding roots of 
this type of equation. A method is explained here in 
detail using the root locus method only as a matter of 
convenience. 


Any rational polynomial with constant coefficients can 
be factored by the root locus method. In order to do 
this the equation is rearranged as in the following steps: 


x4« Ax?+ Bx2+Cx+D = 0 
(xo A)x? + Bx?+ Cx¢ D = 0 
[(x¢ A)x¢ B)x2*+Cx+D= 0 
((¢x- Ax+ B)x+¢ c}x+D ° 0 


(A V-1) 


Next, the expression in the inner brackets () is solved 
as follows: 


(A V-2) (xe A)x+Be 0 


Aas Me +120 


1 es @e 
p (x*A)x 1 


The last expression may be represented by the complex 
number rejJ*. This procedure is the same as was used 
in plotting the root locus of ¥(s)+-1. Thus, using 
x=0 and x°-A as the zeros of the last equation in 


(AV-2), one can plot a locus of points for which 
Ty = 180 K, 44 (See figure AV-1). Next, on this locus 
one finds two points, -a + joand-b+ jq which satisfy the 
conditionIIKr,= 1. In this casek «= 1/B; there are just 
two ry’8: -a and -b. 


(It will be seen that the expression 1/B(x + A)x=-lis 
different from those encountered in the development 
of the root locus method in Section III-4 in that it has 
no denominator. The situation was not covered in 
Section III-4 which deals only with systems in which 
the order of the numerator is lower than that of the 
denominator. However, this property, as well as 
some others dependent upon the poles of ¥(s) pertains 
only to transfer functions of physical systems. But 
the root locus method is not limited to such systems: 
it can be applied to purely mathematical equations, 
i.e., ones which need not be tied-up with the dynamics 
of physical systems. The form of the root locus of 
these equations will differ in some respects from those 
shown previously. ) 





Figure A V-1. (x+A)x*BeQ= (x +a)(x +b) 


Note that the locus comes in from infinity and ter- 
minates at the zeros as B decreases from infinity. 
Having determined roots -a and-b, the next step is 
to substitute the new found factors into the expression 
in the braces ({)} of equation (AV-1) and write 


mation helps to explain a theorem which is used later 
on. 


Let w=» 8-C, , and let C, bea point inside the contour 
C in the s-plane (see figure A IV-11). 


C in ze Plane 
C’ in we Plane 





Figure A IV-11. Napping (Tranel ation) 


Then, rather than shift the contour C through -C,, the 
uy axes are shifted by +C,, i.e., the origin of the 
Gv coordinates is at point c.. The contour C is now 
also the contour C’' in the w-plane. (Note that plotting 
a contour through the function w= s-C, amounts to putt- 
ing the origin of the uv axes at the point C, .) 


Now, let a point s traverse the contourCc ina clock- 
wise direction; using z«re!?, it is apparent that, as 
travels completely around the contour C, the vector 
r swings back and forth through an included angle 
6, but ends up in its initial position so that the net 
angle traversed is sero. Using w=ce!?, it is likewise 
apparent that the vector o rotates through 360° about 
the origin as the point w travels around C’; w travels 
around C’ in the same direction as z travels around C. 


A theorem can now be stated as follows: When a closed 
contour C ig mapped through the function w-z-C,, where 
G lies inside the contour, then, as s travels com- 
pletely around C, w travels once around the origin and 
in the same direction. 






ns- Plane 
nwe- Plane 








=e 


Figure A IV-12. Bapping (Multiple Enci rol ement) 
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This theorem can be extended to the case where the 
contour C has a loop and thereby encircles the point 
OC, twice (see figure A IV-12). It is seen thatas « 
travels completely around C, w travels twice around 
the origin. In general, when C encircles G n times, 
w goes around the origin n times and ¢ rotates through 
2m radians. 


If the point c, is outside the contour c, then w does 
not go around the origin but swings back and forth 
through some angle 6, with net angle traversed equal 
to sero (see figure A IV-13). 


Cin z- Plane 
C' in we Plane 





Figure A IV-13. Mapping 
MAPPING OF A CONTOUR THROUGH THE FUNCTION 
w *C,£. To mapa contour C in the w-plane through 


the function w-C,s , wherec, is a complex number, it 
is best to use the polar form for s and w; thus; 


sere!®; wapel? Cie riet% 
(A IV-2) 
weCserr e('et); wpe ror, b= 05+ 8 


| . 





Figure A IV-14,. Mapping Through wecos 


Thus, the transformation consists in enlarging all 
vectors r by a factor r, and then rotating these en- 
larged vectors through the angle 6, (see figure A IV-14). 
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(In this figure r, was taken to be about 2 units. Instead 
of rotating the contour C, the uv axes were rotated 
through- 6, .) 


The result of this transformation is a contour C’ which 
is geometrically similar to C, but enlarged (if 5 > 1), 
removed from the origin and with its orientation re- 
lative to the uv axes changed by a constant angle from 
its original orientation. 


C in gw - Plane 
C’in w,- Plane 
C“in Ws° Plane 


where C, and C, are complex numbers. Calling 
(A IV-4) Wie Ze C,e Py ei¢:: and Ws" Ze Cs° p,ei% 
one can write (see figure A IV-15): 

we pelea ww, P, Ps elas) 
(A IV-5) 

1 P® Pig, O° >, + Hy 


(b) 


w- Plane 


pP°* AA 
o* $,%, 





Figure A IV-15. Mapping Through (A IV-S) 


The above two transformations can be combined into 
one: 
weC,z+C, 

According to this transformation a contour C is first 
multiplied by C,, giving w’=C,z then the resulting 
contour is shifted by C,, giving w* w'+C,. Graphically 
this can be done by plotting C into C’, as shown in 
figure A IV-14 and then shifting the origin by -C,, as 
shown in figure AIV-10. 


In all the transformation described so far C’ remains 
geometrically similar to C, though its orientation 
relative to the uv axes may be different from that of 
C relative tothe xy axes. 


The theorem stated above can be further extended as 
follows: Let 
(A IV-3) We (Z- C,)(Z- C,) 
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Examination of w, shows that if C, lies inside the contour 
C , p, traveling along C’ in the w,-plane rotates through 
27 radians around the w, origin as z goes completely 
around C. Similarly, p, traveling along C* in the 
w2 ~plane rotates through 2 7 radians about the w, origin 
as z goes completely around C. 


Consequently, when ¢, and ¢, each goes through27 
radians, ¢ which is «¢,+ ¢, goes through 47 radians. 
The theorem is now extended to the case when C contains 
two points, C, and C,, and the contour is mapped through 
w= (z-C,)(z-C,). Then, as z goes once around the 
contour, w goes 27x 2 times around the origin, and in 
the same direction as z (i.e., clockwise, if z travels 
clockwise). 


If both C, and C, are outside the contour C, w does not 
go around the origin but rotates through an angle 
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The half plane lying to the right of the line x-°C is 
x>C (see figure A IV-3). 


JY. 





Figure A IV-4. Radial Straight Line 


Thus, the positive half of the x-axis is 6-0; the nega- 
tive half is 6+ 7, 





Partly bounded areas are designated as shown in figure 
A Iv-5. 


X= 


Ci 


Ca 





Figure A IV-5. Infinite Strip 


Figure A IV-2, Straight. Lines 


A vertical strip is C,<x<C,; a horizontal strip is 
Oy< y< C, . Using the phase angle, the upper half- 
P 





4 e can be designated by 0< 6< 7; and the right half- 
Jy plane by -n/2< 0< +7n/2;if the boundary lines are in- 
Half-Plane to cluded, one writes-n/2« 6<+7/2. The first quadrant 
Right of x°C is either 0 <6 <7/2o0r x>0, y>0; the second quadrant 


is n/2<6<m7 or x<0 , y>0 


A rectangle can be defined by its boundaries: x, + C;; 


Figure A IV-3, Half-Plane 


It follows that x >0 is the entire right half-plane. (Note 
the crosshatching used to designate an area.) Similarly 
y> 0 is the entire half-plane lying above the x axis. 





Straight semi-infinite lines starting at the origin are 
designated by their phase angle, 6 (see figure A IV-4) . Figure A IV-6. Rectangle 
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&a°Cs; yseCs; ysaeCq . The area inside this 
rectangle is: C,<x<C,; Cy<y<C,. Acircle of unit 
radius is r = 1 (see figures A IV-6 and A IV-7). 





Pigure A IV-7. Circle at Origin 


The area inside the unit circle is. r< 1; if the boundary 
is included, one writes: r<1i ; the entire area outside 
the unit circle is r> 1; another way of designating the 
unit central circle is: z-e34. A circle of radius 
g and with its center at 2° z, is ze z,+ ae9 (see 
figure A IV-8). 





Figure A IV-8. Gereral Circle 





Figure A IV-9. Annulus 
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The area inside the circle is z, < z< 2, + 2e!9. 


A ring-shaped area bounded by the concentric circles 
of radii a, anda, and having their center at 4, is 
(see figure A IV-9) 


a,<|3-Z1< a; 


The above examples should be sufficient to enable one 
to identify all the designations to be used later. 


(c) MAPPING 


The problem of mapping is, essentially, as follows: 
given a contour, that is, some closed curve lying in 
the z-plane,and a function w(z), to draw the corres- 
ponding contour in the w-plane. If the function w(z) is 
a simple one, this mapping can be done by transforming 
the contour right on the z-plane. But, generally, a 
separate w-plane must be drawn. 


MAPPING A CONTOUR THROUGH THE FUNCTION 
we z+ C, (see figure AIV-10). 








C in z - Plane 
C’ in we Plane 


Cate 


oo ees ae ee oa 


C, 





Figure A IV-10. Mapping Through wez +c, 


Let there be an irregular contour C in the z-plane. 
To each point on this contour corresponds a point 
wezeC,, where C, is a complex number. It follows 
that w transforms C merely by shifting it in its entirety 
through the distance |C,| in the direction of the angle 
of C,. Rather than draw the contour C in its new po- 
Sition it is simpler to shift the axes to a point -C, . 
Thus, with respect to the uv axes, that is, in the 
w -plane,the map of C is of the same shape and orienta- 
tion asC, but shifted through C,. This map or "image" 
of C is designated by C' 


Analytically, this transformation is arrived at as 
follows: 


C,2°x, *Jy,; Zexe jy; we zeCa(xex des(y ry.) 
(A IV-1) ners ities ° 
Weutjv; Uext*x; VeYry, 


This shows that every point of the contour C is shifted 
horizontally through x, and vertically through y,, 
hence, through the distance |C,;, in the proper direc- 
tion, as was done graphically. This simple transfor- 


-——. 


change in its energy and, therefore, this integral is 
sero, regardless of the shape of the closed path. As 
a second example: Let a man walk along the side of 
a hill. Let the function f(z) be the change in his po- 
tential energy, as he walks around the hill while climb- 
ing or descending. The net change in potential energy 
at any point along the path is the integral of the changes 
GE up to that point. If the man returns to his starting 
point, the change in his potential energy is sero. This 
is another integral which is zero, regardless of the 
path of integration. 


| So 


0,0 = 


Figure A III-12., Tension Spring aa Model of 
Analytic Function 


As a final example, let a torsion spring, (in the shape 
of a rod) have one end attached to the point (0, 0) (see 
figure A IlI-13). 





Figure A III-13. Torsion Spring as Model of 
Analytic Function 


Let the point A of the slider move along a closed curve, 
such as the one in figure A II-13. The torsional energy 
of the rod is proportional to 6¢. As the point 
A comes back to its original position the net energy in 
the’torsion spring (i.e., in the rod) is zero and this is 
true for any path not surrounding the origin, j.e., the 
point where the rod is attached. 


Turning to the function w=1/z, it is seen that it becomes 
infinite at 2-0 (i.e., it has a pole atz-0). This 
function is analytic everywhere in the z-plane except 
at the origin. It is of interest to integrate this function 
along a circle having its center at the origin (see figure 
A I-10). 


Thus along C z+ ae!% dz= iae!9d9; and 


(A 111-36) fg dz = fae ge. 1f""do= ant 
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It is seen that the integral in this case is not zero but 
ani ry For We 1/2", 


aa 16 ae 7 
(A III-37) i,4s dx f° see Bet a t(a-1ag 
. ahr f°" (oos(n- 1)6-1 sin(m-1)6)d0=0 


for all nf 1. 


Thus, [ z°dz is zero for any n, positive or negative, 
except h=-1, for which its value is 2ri. 


If the path of integration is an arc of the above circle 


with the angle of the end pointsz,, and z, being 6, and 
6, (see figure A III-14), the integral becomes; 


(A III-38) 


i Las if, 08° 1(6,-0,) 





Figure A III-14. Integration Along Circular Arc 


if the integration proceeds from z,to 2, , and 
-1(6,-6,) =1(6,-6,) if it proceeds from z, to z,. 


The integral of 1/z® (wherem >} over the same arc 
gives 


(4 111-39) hy LXoosl(a-1)6) - 1 sin [(m-1)6]}46 
As the radius a increases, the value of (A III-39) 
decreases and as a approaches infinity, it approaches 
sero. 

The integral of z° over this arc is: 


(A III-40) 
fPPznaz + fo amet sine! do~ tari el (ariiegg 
| 1 6 
2 iatt! {cos (n#1)4) + isin [(n+1)6)}d0 
i 


This integral varies as a°’',and as a approaches zero, 
it also approaches zero. 


To summarize, the integral of z” over an arc of radius 
a: 


(A IIT-41) a) for n¢-2 and a very large, it z"*dz~0 
b) forn=-1 and any g, foizdz9i( - 6 > 
1 


c) forn>O and a very mall fAztdz~0 


In taking the integral along a simple closed curve (i.e. , 
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one that does not cross itself ),the counterclockwise 
direction is taken as positive. 


It has been shown that the value of a line integral of 
a function depends not only on the function itself but 
also on the path of integration. It will now be shown 
that when the path of integration is a closed curve and, 
furthermore, the function is analytic on the curve and 
at any point in the region enclosed by this curve, except 
at the point z, (that means, z,is a pole of this function), 
then the value of this line integral is a known function 
of this point z.. 


This can be done as follows: The function having a 
pole at z=z, is of the form w(z) = f(z)/(z-z,) (see 
figure A III-15), where f(z) does not contain the factor 
(Z as Zo)e 


t 


ly i 


(a) t—> 


Figure A IIT-15., Contour of Integration Enclosing 
a Pole 


Because of the presence of this pole, the line integral 
around C is not zero. But, one can change the contour 
Cin such a manner, as to avoid the pole; (see figure 
A IlI-15(b). Now the function is analytic on the new 
contour and at all points inside the enclosed region. 
Therefore, the Cauchy-Goursat theorem applies, and 
carrying out the integration as shown in the figure, one 
can write: 


(A III-42) 
@ e 
§ w(z)dz= { wiz)dzs f w(z)dz¢ if w(2z)dz- J.,w(z) dz 





(The negative sign is used because C, is traversed in 
a direction opposite to C,). Since Ps can be made in- 
definitely close to S'P', and since the two lines are 
traversed in opposite directions, the integral over this 
part of the path cancels out. Noting that the integral 
around the circle C, is taken in a direction opposite to 
that of C,, there remains: 


(A III -43) f(z) dz» f. w(2z) dz 


The equation of the circle C, is 
(A IIIT -44) ze z+ ae? 


Also; dz=jaeJ® and z-z,*+ae!%. By substituting 
these values into the right half of equation (A III-43), 


(A III-45) 
. an §0 7 2a iY) 
fj, Habaz Zo f ~L(za.a8") Jae" T dé if, f(z, + 2e7")d0 


The radius a can be made arbitrarily small; in the 
limit it approaches gero. Then equation (A II-45) 
becomes: 


(A 111-46) sf Heez. anjt(z,): 


Z- 2 
and, finally, equation (A eas becomes: 


S., TOS 
This relation is known as the Cauchy integral formula. 
It states that if a function has a pole at some point z, 
(i.e., itis of the form (f(z))/(z-z,)), the integral of 
this function around any closed curve surrounding the 
pole is equal to 2njf(z,.) where f(z,) is the value of 
f(z) at the pole. 


(A ITI-47) anjf(z,) : 


As an example of the application of the Cauchy integral 
formula, let w(z) = sin z/(Z-z,)(which shows that w (z) 
has a pole at z+z,). Then the integral of w(z) around 
a path which encircles the point z, is: 


§ wiz)dz- § =e dz = 2nj sin z, 


= 2nj(sinx, cosh y,+jcos x, sinh y,] 


SECTION AIV ~ MAPPING 


(a) INTRODUCTION 


One of the methods for investigating the stability of a 
servomechanism is based on the use of the so-called 
"Nyquist criterion." In order to understand the deri- 
vation of this criterion it is necessary to know some- 
thing about the operation of 'mapping"' of a given contour 
from the z-plane into the w-plane. Furthermore, before 
a discussion of mapping may be begun certain funda- 
mental concepts regarding plots in a complex plane 
must be understood. For these reasons the presentation 
in this chapter will be as follows: 


1. Fundamental concepts — methods for designating 
points, lines and areas in a complex plane. 

2. Mapping. 

3. Nyquist criterion. 


(b) METHODS OF DESIGNATING POINTS, LINES 
AND AREAS IN THE Z-PLANE 


It is important to become familiar with the ways used 
to designate points, lines and areas in the z-plane. 


In the theory of complex numbers it is shown that a 
fixed point in the z-plane is designated by z, =x, + jy, 
(see figure AIV-1). 


Straight lines when unlimited, are designated as follows: 
The y axis is x-0; the x axis is y~-0; a line parallel 
to the y axis and at a distance C from it is x= C; when 
C> 0, the line is in the right half plane (See figure A 
IV-2). The designation of certain other lines is shown 
in figure A IV-2. 





points on this plot; for instance, any Zz, which makes 
the polynomial in the numerator, N(z), vanish gives 
w(z.) = 0; but the z’s which make the numerator vanish 
are the roots of the equation 

(A IIT-25) N(z)* Agz®s Ay. yzt-tes * c#Ay = 0 

Let those roots be p,,P,...D, ; then (A III-25) can be 
factored into 


(A IIT-26) N(z)* (Z- py) (B- g)* * *(B~ Dy) 


where the p’s are complex roots of N(z). When z as- 
sumes each of these values, N(z) vanishes, and so does 
w(z) ; therefore, w(p, )w(D)...W(p,) are all zero. The 
roots P,.D,-..-p, Of N(z) are called "zeros" of w(z) ; 
they all map into the origin of the w-plane. 


Any z, which makes the polynomial p(z) vanish causes 
w(z) to become infinite. These z values are the roots 
of the equation 


(A III-27) D(z) = B,z*+ B,_,2°"4+* * °B, = 0 


Let these roots be s, ,8;,- 1B, ; then 
(A III-28) D(z) © (Z- 83) (Z- 83). « »(Z> Bq) 


Thus, w(z) becomes infinite for z=8,,2=83...2°8, ; 
these are called the poles" ofw(z). Since w(z,), w(2) 
. +. ¥(Z,)are infinitely large, they cannot be plotted in the 
finite portion of the w-plane. 


To show them, an “artificial representation of infinity 
is introduced; the locus of all infinitely large w’s is 
shown as a circle, about the origin, of finite radius R ; 
and it is specified that R approaches infinity. 


For all values of z other than the zeros and poles of 
w it is necessary to substitute a number of z’s into the 
polynomials of (A III-24) and to solve for the corres- 

values of w. If the z‘s lie along a closed curve, 
the plot in the w-plane is also a closed curve; the area 
inside this curve will plot into an area in the w-plane 
but, not necessarily inside the w-curve; it can also fall 
outside the w-curve. The subject of mapping is an 
important one in the study of servomechanisms. More 
about it is given in Section A IV of this appendix. 


INTEGRATION OF FUNCTIONS OF COMPLEX VARI- 
ABLES 


The integral § f(x) dx can be thought of as the area under 
the curve y=f(x). It is the limit of the sum of the 
areas of the rectangles whose base is Ax and height is 
y=f(x), as Ax becomes indefinitely small and the num- 
ber of these rectangles becomes indefinitely large (see 
figure A II-6). 


y= f(x) 


ay 


1," 


Figure A III-6. Integration as Limit of Summation 
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Should one form the integral /w(z)dzand think of itas . 
the limit of the sum of the rectangles whose base is 
dz and height w= f(z), the same difficulty arises as in 
the case of differentiation, namely, in which direction 
is Az to be taken. If/f(z)dzis to have a definite mean- 
ing, the direction of Az: has to be prescribed; and this 
is done by picking out, of the infinite number of z’ s in 
the z-plane, only a set of 2's which lie along some 
Single selected line in the z-plane. For this reason 
the integral is known as a "line integral'’; it is de- 
signated by the symbol J, f(z)dz (see figure A III-7) . 









ad 


C (Path of 
Integration) 


ly 





Figure A III-7, Line Integral 


If the line has as its end points the values z, and 2,, 
the integral is a definite one, {+ s°f(z)dz. These end 
points may be anywhere in the z-plane. If the points 
Zz; and Z, coincide, i.e., the line is a closed curve, 
the integral is sometimes designated by the symbol ¢. 
The line selected in the z-plane is known as the "path 
of integration" (see figure A III-8). 


C (Path of 
Integration, 


a Closed Curve. ) 
iy 





xX ——--» 
Figure A III-8. Closed Contour 


A frequently used path of integration is a circle (see 
figure A III-9). The equation of such a circle is 


(A III-29) zZ=Z,+ ae!9 





Figure A III-9. Circle z= 2, + ace 19 


This means that any point on this circle can be located 
by a vector which is the sum of z, and of the vector a 
whose angle with the positive x-axis is 6. 


If the center of hr circle is at the origin of the z-plane, 
the equation (A III-29) simply becomes: (see figure 
A TI-10). 
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(A III-30) z= ae! 





Figure A III-10. Circle s= ae? 
As an example of a line integration, let wez2 be in- 
tegrated along the above circle (figure A II-10), 
seac!¢, For this path weaze2i¢; dz = iae!%dd; then 
(A 11-31) §wdse fate! 204 ac%d6- iatf"ot2a6 
oia® [cos 3940-09[ sind 04 9°0 


Thus, the integral is sero and is independent of the 
radius of the circle used as the path of integration. 


If the path of integration is the circle shown in figure 
A lI-9, the integral is still sero, as shown below: 


It is seen that for w-z?, [ wiz is zero whether C isa 
large circle, a small one,or even a square. Had the 
square been n times a8 large (see figure A I-11 (b) ) 
the limits would become zero andn; along BC z=n+iy 
along CD z= x-+in; the integral now would be: 


(A III-34) 
fs*dz- Sixtdxe Sine iy)? idy+ [°(x0 inyuxs Sty)? Ady 

s fi x2dx- in?{"dy + in{ 1 aydy + if 1y%ay 

¢ fxtaxe inf axdx+ itndxs i[°1#y3dy 

o f'xtdxs indy - nf aydy > 1f° y*dy - fo xtdx 

. inf” axdx + n?{"dx+ ify 2ay 

e in?- n®- in®+ n? = 0 
It is clear that $z2dz is zero for any finite size of 
square. By trying other paths of integrations it will 
be found that $22dz is zero for any path. This is true 
because z? is analytic at any finite point in the s-plane. 
And it can be shown that for any function of z which 


is analytic at any point in the g-plane the integral 
along any closed curve is zero. 





(A 112-32) wos,+00'?; sto 22+ dane’? s ate3!?; deo ine!(dé; 


: a" 
fzidz= if" staewaos if'"a az 0126d 6+ if atei8?d 0 » 


aa Ow " 
eizca f (cos +i sind)d6+12 a*z, f fcos2 6+ isin 26)d6 +1 arf (cos3 0+ isin 36] d@« 0 





In this case, too, the result is independent of the radius; 
nor does the position of the center of the circle matter. 


As another example, let the same function w= z2 be 


integrated along a path which is a square in the Z-plane 
(see figure A III-11(a)). | 


us| 


0,1 i,i 


0,0 





10 ">> 


Figure A IIf-11. Rectangles as Paths of Integration 


It is seen that along AB z= x;dz=dx, since y does not 
change; along BC z=1 + iy; dz= idy, since x does not 
change; along DC z+x+i;dz-dx; along AD ze ly ; 
dz = idy. 


Integrating along the sides of the square, counterclock- 
wise, gives for the integrals along aR, BC, CD,and DA 
respectively: 


(A III-35) § f(z)dz= 0 
for any closed path if f(z) is analytic anywhere in the 
z -plane. 


This property of analytic functions, which is given here 
without proof, but only made plausible by a few ex- 
amples, is the content of the Cauchy-Goursat theorem. 


Such a property of a function is without precedent in 
the realm of real numbers and might, therefore, prove 
somewhat puzzling. To make it easier to accept it, 
one may think of some physical models in which an 
integral of a function exhibits similar characteristics. 
For example, let a tension spring be attached at the 
point (0,0) (see figure A I-12). 


The free end, A, is made to follow the curve c. At 
any point z along the curve the extension of the spring 
is|z|-|z,| . The potential energy & is proportional to 
Cilz|-|z9|]*. Thus & is a function of z. The net in- 
crease in energy at any point is the summation of the 
changes in energy up to that point. The total change 
in energy as A returns to its initial point is the in- 
tegral of the change dE along the curve. And, since 
the spring ends up in its initial condition, there is no 





(4 IIT-33) f z¥dze ['x7dx. fas iy)* idy + Sica if dx¢ Say? idy of xtdx+ if’ i2y - y2) dy fo (x24 12x- 1)dx 


1 i 
= Af 12ytay =f! xtdxe if'ay- favdy - if'ytdy- [xtdx- 1 ands +f'dxe if'y2dy #1-1-141+0 
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THE DERIVATIVE OF w WITH RESPECT TOz. 


Since w is a function of z, it is of interest to find the 
derivative dw/az. 


The real function y = f(x) has a derivative dy/dx (see 
figure A III-2); this is a known quantity for any given 
value of x: it represents the magnitude of the slope 
of the curve f(x) at the given point x. The expression 
for dy/dx may contain, in addition to x and functions 
of x, also functions of y; but since y must lie on the 
known curve y= f(x), y is completely specified for a 
given x. 





Figure A III-2. Derivative of a Real Function 


‘The derivative dw/dz will now be found. 


The derivative dy/dx has been defined as the limit of 
the ratio Ay/Ax as the increment Ax approaches zero. 
This Ax is a change in x along the x- axis and dy is 
the corresponding change in y as the latter moves 
along the curve (see figure A III-3). 





ox 
Figure A III-3. Finite Change in y 


If one were to define dw/dz as the limit of the ratio 
Aw/dz, a8 the vector z is given an increment 4z, and 
Az approaches zero, a difficulty would arise; for 
while, in the case of 4y/Ax, xis constrained to move 
thru the increment Ax along the x-axis, z can "move 
through Az. in any direction at all; and this would 
mean that dw/dz might have any number of values, 
depending on the direction of Az. (See figure A III-4). 





Figure A I11-4. Possible Changes of 8 


Appendix 
Section A III 


Obviously, in order to use this definition of a derivative 
and still have a definite single answer, the group of 
functions to be dealt with must be narrowed down to 
those which are So constituted that dw/dz has the same 
value regardless of the direction of 42. Just what the 
condition is that is imposed by this requirement can be 
found by the following reasoning: Let 





7 ree Aen Ax +idy 


and let 42 lie along the x-axis; i.e., Az=Ax; then 


(A III-10) elim UTLAY. lim (@2 +1 RY) « 2u 44 2Y 
Now, let dz lie along the y-axis; i.e., Aze Ay; then 
(A III-11) 

aE at TBy alts, (FRG BS) “Hy BY 


If the derivative is to be independent of the direction 
of dz, these two expressions for dw/dz must be identi- 
cally the same; hence, 


eu ony OU, OV 
(A III-12) ou ot SY i 5y° sy 
or; 

ou, ov ov, .2u 
(A IIT-13) ox «ay ne ex ey 


A function we f(z) = f(u, v) « P(x, y) ¢ if (x, y) 
which satisfies the condition (A II-13) is called "analy- 
tic'' at the point z where it has a derivative. The equa- 
tions (A III-13) are known as the Cauchy-Riemann 
conditions. 


For the function wz? given above: 


ou ou 


ue x2- y3 ° 2x == -2y 
.) 
(A III-14) ‘ ey 
- wv, ov. 
ve 2xy ay 2x ax 2y 


This function is analytic at any point in the finite z 
plane. It satisfies the condition (A III-13). 


Thus,dw/dz « d(z*)/dz, « 2z; the differentiation is carried 
out as in the case of a real function; the derivative, 
22, has a definite value of any point z. 

For the function w= 1/zs 


x y 
use yee 
x24 y? x24 y3 


ES (x? ty") 5.9% , - 2 
ax (x“¢ y°) CTL 


ay (x44 y4)-y. dy | y?- x? 
(A III-15) (x2¢y%)2 (x34 yy? 


du, 0- 


xX. 2Y_ . 2y x 
AY (xte yy? (ade yd)? 
ov, ._O-y.2x , 2x 
Ox = (x¥e ya) (xis yh? 
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Thus, w= 1/z is analytic at all points z, except z=0, at 
which u and v(-0/0) do not exist, nor does the deriva- 
tive. At all other points 


@- Qs 


It can be shown that w > z® and dw/d2enz®-! exist and (nin- 
tegral) are analytic at all points in the s-plane when 
n>0O. Whenn<0O, w has a derivative at all pointz 
except at the origin, i.e., at z«0. 


(A III-16) 


The sum or the product of two analytic functions is 
also an analytic function, Thus, any polynomial 
(A I1I-17) We @,¢ O,5¢ az%eesoa gt 

is an analytic function, in the finite portion of the 
-plane. 


The quotient of two such polynomials is analytic except 
at those values of z which make the denominator vanish, 
i.e., for which w is infinite. 


It can also be shown that sin z, cos z, and other trig- 
onometric functions of z, all of which are expressible 
in power series of z, are analytic except at certain 
‘points; and the same is true of the hyperbolic functions 
ofz. Also: if sin z is an analytic function of z, and 
(1+2%) is also analytic, then sin (1 + 22) is also analy- 
tic; i.e., it can be shown that an analytic function of 
an analytic function is itself analytic. And in all cases 
it will be found that the analytic functions satisfy the 
Cauchy-Riemann conditions (A III-13). 


An example of a non-analytic function is 
(A IIT-18) wean Ze (xe ly)(x- ly) = x4¢ yteue iv 
where u= x?¢ y2,_ v=o; obviously 2u/0x# ov/dy. 


It should also be mentioned that a function fails to be 
analytic at a point where it is multiple-valued. An 
example is w« z* = +/Z; for this simple function, things 
can be redefined, of course, so that the plus of the 
double sign is always taken, which makes 2 single 
valued; but until this is done the function as it stands 
is not analytic. 


From this point on only analytic functions will be dealt 
with. 


EXPONENTIAL FUNCTIONS OF z 
What is the meaning of w-e*%=e"*'”? To arrive at 


the answer it is convenient to consider the series 
expansion of cos ¢, sin 9 and e® ; 


2 4 6 
(A III-19) cos g+1- $4 2. 2, ge 


Ce: Ac * cee ° Lm 
sca eal” pander 


6a Oe OO By ew: ee 
l!o62!o3! 4! 5! 
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Expanding e!9 formally according to the last series 


gives: 
(A T1t-20) esi £- Gr -1 Ges Foi Ge 
- £18 ae 


If the sin 6 series is multiplied by i and added to the 
cos 6 series, the result is the series (A III-20); there- 
fore: 


(A III-21) oe! acosd+i sin 6 


Now 
(A III-22) e82 et¢1F¥ « etgiF« eX(cos y+ i sin y) 


This is what is meant by the exponential function w-e*, 
This is an analytic function, as can be shown by applying 
the test for the Cauchy-Riemann conditions: 


e*= e* cosy+ie™ sinyeuriy 
where u-e%cosy and v-e'siny, 
(A III-23) 


2. e* cosy; & . et cosy; SU. - et ainy; et siny 


FUNDAMENTALS OF MAPPING 


Since we f(x,y) + 1¢(x,y) andz=x-+ iy, it follows that 
to each z,=x,+ ly,, there corresponds aw,* f(X,.¥,) 
+1¢(x,,¥,) . Anew complex plane can be defined in 
which there is a u-axis, the axis of reals, and a v- 
axis, the axis of imaginaries; then one can plot w in 
this plane as a function of u and v; this is then the 
"w-plane." To each u, and v, there corresponds a 
Ww; then to each z, (in the z-plane) there corresponds 
a w,(in the w-plane), If all the z’s along some curve 
in the z-plane are plotted in the w-plane, the result 
is a curve in the w-plane which is called the 'map" 
of the curve in the z-plane. If all the points in a given 
area in the z-plane are plotted in the w-plane, the 
result is an area in the w-plane. Thus, both curves 
and areas can be mapped from one plane into the other. 
(See figure A III-5.) 


w- Plane 








z - Plane 





ivl 


C ‘(Map of C) 






Figure A III-5. Mapping Through w= f(z) 
Let 


; _ Agztt Zeta 2 . N(z 
UMS Mee a oe tas 


where N(zZ) and D(z) have no common factor. 


It is required to plot this function in the w-plane. In 
order to do this it is convenient to locate first certain 
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vergence depends directly upon the relative magnitudes 
of the roots. For this reason, when the process appears 
to be going too slowly, it is worth while to subject the 
polynomial to a transformation which will increase dif- 
ferences in magnitudes of the roots. Graeffe's method 
may be used for this. If there is any appreciable sepa- 
ration in the size of the roots, squaring them once or 
twice will give a transformed equation for which Lin's 
process will converge with satisfactory rapidity. Asa 
matter of fact, the roots are usually far enough apart in 
the equations met with in controls work so that it is 
seldom necessary to transform the polynomial in this 
way. 


As a numerical example, the location of the roots of 
(a3 + 3z¢ 5)(22¢Z¢ 1) © 266 929+ Bz8+72+820 ~~ will 
be obtained from a knowledge of the unfactored form. 
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Figure A I-32 shows the necessary work. 

It will be noted that four cycles of Lin's process de- 
termines the quadratic factors with errors of less 
than 1% in their coefficients. ) 


The magnitudes of the roots of the factors are 1 and 


YB"= 3.24. It will be seen that the ratio of the magni- 


tudes is not very much greater than unity; despite this, 
the convergence of the process is fairly rapid. 


Detached coefficients have been used in the working . 
out of this example to shorten the process. A little 
practice in applying the method will enable one to 
simplify it still further by omitting the writing of 
various numbers occurring in the process. However, 
it was felt that the whole work should be shown here 
to facilitate checking one's understanding of the process. 


SECTION A Ill - THE ROUTH-HURWITZ STABILITY CRITERION 


In dealing with stability problems one oftentimes has 
to decide if the roots of a given algebraic equation of 
nth degree, such as 


(A II-1) az" + CO Wa OO Ce A a, » 0 


| all have negative real parts. The coefficients 
Goreee GM, are real numbers. 


A general criterion given by Hurwits is that then de- 
terminants: 











(A II-2) 
D,ea,; Das}a, 8}; Oye; a, a 0 
By 8, By a Wy 
a, Bo 0 ee « QO 
a3 a2 ai 6 e© ©) 6Q 
eoce5e D, * a, 


must all be positive. The coefficient a, must be 
positive or must be made positive (by multiplying 
the equation by -1). 


This stability criterion results in simple rules for 
quadratic, cubic,and fourth order equations 


For the above three types of equations the rule states 
that all coefficients must be positive. In addition, 
for the cubic equation 


(A II-3) a2? ¢ uz Qoz+u,* 0 
there is the condition that 


(A 11-4) &,8,- 8,4, > 0 


For the equation of fourth degree 


(A 11-5) ao7*+ a,z?+ anz?+ area, = 0 


the additional condition is that 


(A II-6) @,(8,8,- 083) - a2 a> 0 

For equations of higher degree than the fourth all 
the determinants (A II-2) must be formed and the 
value of each must be tested for its sign. 


Another, more general criterion, the Routh criterion, 
is given in Ghapter VII, Section 9, of "Transients in 
Linear Systems" by Gardner and Barnes. In addition 
to indicating instability it also discloses the number 
of roots with positive real parts as well as the number 
of purely imaginary roots. 


As an example of application of the above stability 
criterion let it be required to investigate the stability 
of the motion of the pendulum shown below (see figure 
A W-1). The pendulum is rotated about its axis o-o 
at an angular velocity « rad. /sec.; it is deflected 
laterally thru a small angle a; will this angular de- 
flection die out, or will it diverge? 





OOMBAT 





Figure A II-1. Penclulum (Stability) 


It is assumed i: it w is constant; that the mass of the 


pendulum is concentrated in the bob, c ; and that the 
lateral motion is opposed by viscous friction. 
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The equation of motion of this system is: 

(A II-7) Be Wade (§ -aa)a - 0 

where 2n is the damping coefficient; g is the gravi- 


tational acceleration constant. Assuming a solution 
of (A II-7) of the form a» ®t there results the equation 


(A IT-8) 82+ ass (Ea) = 0 
and 


(A II-9) 8,592 -na [a2 (g- 0) 


If g/ £- «2 >0, the real parts of both roots, s, and s,, 
are negative; this corresponds to a condition of sta- 
bility, i.e.,the oscillation will die out; if g/2-w* <0, 
or, calling g/2- w4s-p, 


(A II-10) 87+ 2ns-p =0 


it is seen that the root s- -n+Jn7+ pis positive; this 
corresponds to instability of the lateral motion. 


This shows that (A II-10), which does not comply with 
the condition that all coefficients be positive, indicates 
an unstable motion. 


SECTION A III = FUNCTION OF A COMPLEX VARIABLE 


(A pre-requisite for the understanding of this section 
is a working knowledge of the elements of the theory 
of complex numbers. This includes the properties of 
complex numbers, the various ways of representing 
them algebraically and graphically; and the funda- 
mental operations of addition, subtraction, multipli- 
cation, division, evolution and involution of complex 
numbers. ) 


CONTENTS OF THIS SECTION 


This section introduces the concept of functions of 
complex variables; it defines analytic functions and 
discusses some of their properties; it introduces the 
complex w-plane, in which functions w of the complex 
variable z are plotted; it discusses poles and zeros of 
w ; finally it deals with the line integral of w.* 


The material presented here is a useful tool in the 
study of various technical subjects, especially in the 
study of electrical circuits and of certain phases of 
Servomechanism Theory. 


INTRODUCTION OF w(z), A FUNCTION OF THE 
VARIABLE z 


Let z be a complex number z=x+ iy. When y-0, z 
becomes real. Thus real numbers may be considered 
a special case of complex numbers. 


The function y = f(x) of the real variable x may be 
represented as a curve in the xy-plane. The value 
of y which corresponds to a given x is found on the 
same horizontal line as the point on the curve which 


<= 


ye f(x) 


x i—_- 
Figure A III-1. Real Function 


* z is used as the symbol for a complex number (in- 
stead of s as in the body of this volume) to cor- 
respond with traditional mathematical usage. 
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lies vertically above the givenx. It may be stated 
that: As x moves along the x-axis, y moves along 
the curve f(x) as shown in figure A ITI-1. 


Now, one may think of the function y - f(x) of the real 
variable x as a special case of the function w= F(z) of 
the complex variable z. The function w - F(z)is a 
generalization of the function y - f(x), just as z isa 
generalization of x 


Since z=ex+¢ iy, weP(z) eF(x¢iy). It is of interest 
to find the relationship betweenw, and x andy, when 
the relationship between w and z is known. 


The following example shows how this can be done. Let 


(A III-1) we f(z) = z? 
Then 
(A III-2) we (x+ ly)2e (x3- y2) 61 2xy 


Thus, w is itself a complex number; designating the 
real part of w by u and the imaginary part by v, 


(A III-3) us x?- y? ve 2xy 
and 
(A III -4) weueiv 


It may be seen that the real and also the imaginary 
part are functions of x and y. 


(A IIT-5) we F(x,y) + 1d(x,y) 


Another example: let 


oi 
(A III-6) wee 
Then 

1 x : ae 

(A III-7) W" xely aay? i x2ey2 ueiv 
where 
A III-8 s poe Sead . a cha: Eee 
( ) . x2ey2 ’ : x2+y2 
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of error in the computations. For these reasons, as 
well as the fact that the process is rather commonly 
known, this method will not be discussed further here. 


Lin's method is probably the most usable of all the 
present processes for the extraction of complex roots. 
It takes out the roots as quadratic factors; since each 
pair of complex roots gives rise to one such factor, 
it may be said to yield the roots themselves directly, 
in a form requiring only the application of the quadratic 
formula. It has the further advantage that the com- 
putation is iterative; errors tend to slow down the work, 
but do not absolutely prevent getting the correct final 
result. 


It suffers from what appears to be the common defect 
of all present methods of accomplishing the same end; 
if two pairs of complex roots are very nearly equal in 
magnitude, the process converges slowly, and may 
need many repetitions of its basic procedure before a 
sufficiently accurate result can be obtained. It is also 
true that in some rare cases Lin's method diverges 
rather than converges. The conditions under which 
this may occur are not fully understood; it happens 
only very seldom, in any event, and is practically 
always obviated by taking out all real roots first. 


. Essentially, Lin's method is this: The last three 
terms of a polynomial are used as a first approxi- 
mation to a quadratic factor. The polynomial is divided 
by the first approximation. The result is a quotient 
and a remainder. 


(1) 25 + a,.,2°° 1+ eee + a,z?+ a,zt a, e 0 


(2) First trial divisor 


3,5 = (1) Ay. 
z ioe a+ oi at QO qh 
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Certain coefficients in the quotient are used to get a 
new trial divisor from the old one. 


In this process, the remainder has no use but to serve 
as a measure of the closeness of the approximation to 
the correct value. The method is repeated until the 
remainder is within some assigned limit of approxi- 
mation; or, until it remains of the same magnitude 
after several repetitions of the process. If this last 
occurs, it indicates that the result is as accurate as 
can be attained with the number of digits used in the 
coefficients. 


It should be noted here that the first cycle of Lin's 
process gives an approximate factorization of the 
polynomial. If the coefficients are literal, this first 
cycle is all that it is practicable to use. However, in 
practical situations as in the case of the stability 
quartics, the approximate factorization works out 
excellently. 


Figure A I-1 shows the application of the first cycle of 
Lin's method to a general case. This illustration shows 
how the first trial divisor is obtained from the quadratic 
terms of the polynomial, in line (2); it also illustrates 
the notation used in the quotient, and shows in line (4) 
how the next trial divisor is obtained from the appropri- 
ate terms of the quotient and dividend. The subsequent 
trial divisors are obtained in a similar manner. 


If the polynomial being investigated has a pair of com- 
plex roots of very nearly equal magnitude, the con- 


(1, & 
qd,°Q a 


(3) Z3¢d{H2edql)) 224 azole ee + alztt a, zeal (zo° 2+ (a. dl) 2-3 


g" + at) girl 


ey dP 


(a,. yd) zn- 4. 


(4) Second trial divisor 


24 q(2 2 (2) 
Z2+4 d(2)z+ al?) dj,“ 


d(2). To 


+ © 8 Gz? +ql z+ qi) 


&,Z+ a, 


1 ¢) Sear 0 
(ry2e* rg’) remainder 


Figure Al-1. Lin's Method for the Complex Roots of a Polynomial 
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8+7+52 8 (1 + 7/8 + 5/8) = 8 (1 + 0.875 + 0.625) 


+ 0.875 + 0. 1 + 3.000 + 8.000 + 7.000 + 5.000 (1+ 2,125 
1 + 0.875 * 0.625) | _ 6.875 - 0.625 (+ 5.516 
2.125 + 7.375 + 7.000 
-2.125 - 1.859 - 1,328 
5,516 + 5.672 + 5.000 
-§,516 - 4,827 ~ 3.448 
+ 1,845 + 1.552 


a,°7 qQ, * 2.125 
a, « 5 Q, * 5.516 


@,9, - 89, 27.987, 
d, oat + Wh. aes 0.920 


Pn eee 
4, 5.16 ° °° 
+ .990 + .906) 1 + 3-000 + 8.000 + 7.000 + 5.000 (1 + 2,080 + 5.180 
1 + .920 + .006) 1 _ 0.920 - 0,908 
2.080 + 7.094 + 7.000 


.080 - 1,914 - 1.884 
5.180 + 5.116 + 5.000 


-5.180 - 4.766 - 4.693 
+ 0.350 + 0.307 


d, = (1) (5.180) - (5)_ (2.080) 
(5. 180) 


. 20.86  . 
26.8324 ve 


nc Bi 0. 
a eT 





£ 





teen aery - 0.964 - 0.965 
2.036 + 7.035 + 7.000 


-2.036 - 1,963 - 1.965 
¢ 5.072 + 5.035 + 65.000 


~ 5,072 - 4,889 - 4,894. 


0.146 + .106 


a, = (D_(5.072) - (5) (2.036) 
. (5.072) 2 


. 20.324 ‘ 
25. 725184 meng 


= 0.986 





a0 
do 5.072 


1 + 0.984 + 0.986) ! * > ona En ae 
= 0,984 - 0,986 
2.016 + 7,014 + 7.000 
- 1,984 - 1,988 
5.030 + 5.012 + 5.000 
-_ 4,960 
0,062 * 0.040 


(1 + 2.u16 + 5.030 


(1) (5.030) - (5) (2.016) 
“————{5,000)2 OS 


. 20.130 
25. 3009 


= 0.993 


= _95_ = 0,994 
qo * 363 


1 + 0.993 + 0.994) 1 + 3.000 + 8.000 (1 + 2,007 + 5.013) 


2.007 + 7.006 + 7.000 


__7~ 1,993 - 1.995 
5.013 + 5.005 + 5.000 
- 4,978 - 4.983 
0.027 + 0.017 


Figure AI-2. Example of Lin's Method 
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SECTION AI - ROOTS OF ALGEBRAIC EQUATIONS 


One method of determining the transient response 
of a dynamical system is to calculate the roots of the 
characteristic equation (the characteristic equation is 
the denominator polynomial of the transfer function 
set equal to zero). As was pointed out in the main 
body of the text, most of the methods available to 
find roots are tedious and are avoided when possible. 
However some simple cases may be effectively handled 
in this way, and for this reason the following dis- 
cussion is presented. 


The problem is: Given the equation 
(A I-1) 


find the values of z for which the equation is satisfied, 
when the a,(i= 1,2,3,...n) are known real quantities. 


z®+a,z*-'+,..ea,.,2¢ a, © 0 


It can be proved rigorously that the desired roots 
are never anything other than complex numbers, with 
real numbers considered special cases of complex 
numbers. 


It is a matter of common experience that real roots 
are much more easily located than are the complex 
ones; it is also true that some of the methods-for find- 
ing all of the roots tend to work out considerably better 
when the equation has only complex roots. A logical 
procedure is then: 

1. Determine real roots and remove them from 

characteristic equation. 

2. Determine complex roots from remainder. 


Standard graphical and numerical methods for doing 
this are well known, such as the Newton-Raphson 
method, Horner's method, and the so-called "method 
of false position." For those wishing to study these 
in detail, standard references* provide ample material. 
They all depend, however, on first obtaining at least 
a rough approximation to a reai root, and then im- 
proving the approximation. This can be done to any 
degree of accuracy desired, by these methods. 


In the general case, there is no information about the 
characteristic equation to indicate if there are any 
real roots. The initial step :s to obtain some in- 
formation on this point. A method due to J.C. F. 


Sturm, a French mathematician of the early nineteenth 


century , which determines if an equation has real 
roots,will now be presented. The method may be 
stated rather simply and is presented here without 
proof. 


Let the characteristic equation be 
P(Z)= az" + az? leeera, = 0 


From the given P(z), a sequence of functions is derived 
as follows: 


The first Sturm function, referred to as that of zero 


* Willers, Dr. P.A., Practical Anilysis, Dover, N.Y. 1948. 


Milne, W.E., Numerical Calculus, Princeton U. Press, 
Princeton, N.J., 1948. 


Scarborough, J.B., Numerical Mathematical Analysis, 


The John tlopkins Press, Baltimore, Md., 1930. 


order, is P(Z) itself: 
(A 1-2) 8, = P(2) 


The second Sturm function is the derivative of P with 
respect to 2, dP/dz, . 

(At-3) 80 

The third Sturm function is derived from 8, and 8,, a8 
follows: Divide 8, by8, ; the result will be a quotient 
Q, and a remainder R, ; the latter will be of degree 
n-2. The quotient is of no further use in the process, 
and is discarded. The remainder, with changed aige- 
braic sign, is S,. In symbols, if 8,/6,+* Q,+ (R,/8,;) 
then: 


(A 1-4) 8, ° -R, 


The further Sturm functions of the sequence are ob- 


tained by using the following formula; 5-1. q , *« ; 
and the definition 5, 5, 


Braye -Ry 
that is, by repetitions of the general process giving R, . 


(A 1-3) 


Since the degree of each successive Sturm function is 
one less than that of the preceding one, the process 
will finally end with an 8, which is a constant, not 
dependent upon 2Z. 


The whole sequence of Sturm functions for P(z) is 
then: 


(A I-6) 
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Sa = K 
where K , of course, is a constant. 


The location of the real roots of P(z) is then carried 
out by applying the following rule: 


If it ig desired to determine the number of real roots 
of P(z)=0 lying between the (real) values a and b of 
z , evaluate each of the functions S,(a),8,(a),...K,and 
8,(b) 8,(b),....K. The number of real roots between 
a and b,is then the difference in the number of changes 
of sign between the two sequences of functions. 


It is to be noted that since only the algebraic signs of 
the functions of the two sequences is of interest in this 
rule, the ari.q:,etic used in establishing what the 
sequences are can be considerably simplified. Any 
function of the sequence (A I-6), for example, can 
be divided through by any positive constant which will 
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make the work easier, Instead of using 8, as it stands 
in (A I-6), it:may be divided through by n to facilitate 
computation. 


The rule makes it very easy to settle the question 
of whether P(z) has any real roots or not. In this 
case, the constants a and b may be taken as + and 
-© , respectively, and the evaluation of the functions 
of the sequences is then simply a matter of inspection 
of the algebraic sign of the terms of highest degree in 
z. If theS have two changes of sign for z= + and 
four changes of sign for Z*-%, then, by the rule, there 
are exactly two real roots of the characteristic equation 
P(z)-0. 


It should also be mentioned that the presence of positive 
real roots may be determined very easily by this 
method. In this case, the functions are to be evaluated 
for ze «© and z*0. The former gives simply the 
algebraic sign of the terms of highest degree, as before; 
and the latter, that of the constant terms; examination 
of this range of the variable can then also be carried 
out by inspection. 


The use of the Sturm functions can be extended to the 
process of getting initial approximate values of the 
roots for refinement by one of the standard methods. 
The a and b used above in the rule are any real numbers 
at all, and by taking trial values of these, the Sturm 
process can be used to locate ranges of any size at 
all in which roots must lie. Theoretically, the Sturm 
functions can be used to locate the roots with any ac- 
curacy desired; however, the computational work 
involved in their use for this purpose is considerably 
greater than for more usual techniques, and their 
greatest utility is achieved in merely determining 
fairly broad ranges of values in which the roots must 
lie. 


An important exception to the use of these functions 
must now be noted; the Sturm functions will always 
do the job they are supposed to, when they exist; how- 
ever, if S, contains higher order roots, it will be 
found that the result of the first division, S,/S,, has 
no remainder. In this case, the process does not 
apply. There are ways of avoiding this, but in controls 
work the case of multiple roots of P(z) occurs so 
seldom that they are not worth considering here. 


For the sake of illustration, a numerical application of 
Sturm functions now follows; consider the characteristic 
equation: 


(A I-7) z®- z§- 1424- 2° + 2527 + 38z + 24 = 0 
The corresponding sequence of Sturm functions may 
be computed as: 
(41-8) 89° 2°- Z°- 14z4- 25+ 2527+ 382+ 24 
8,* 2°- 0.833z*- 9.333z9- 0.527 + 8.333z+ 6.333 
8,° 24+ 0.4282z5- 3.45027 - 6.879z- 5.214 
8,* z3- 0.380z7- 0.910z- 0.045 
8,* 22+ 2.772z+ 2.351 
8,° -Z- 1.31 
8,° -0.431 
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The information obtainable from these, in accordance 
with the rule given above, is best indicated in tabular 
form: 


Number of 

B, 8; 58g Sy 5, 5g 56 sign changes 
0 ¢ + ¢ + ¢+Xe = 1 
Oo +¢ +Xe- -xX+ Xe - 3 
-M +¢x-x*+X-xXe *#2X-° 5 


The crosses have been placed between the signs of the 
functions of the sequences to indicate where the sign 
changes occur. 


It is seen that there is a difference of four changes of 
sign between -~ and+o ; the conclusion is that the given 
P(z) has exactly four real roots; since there are 
differences in changes of sign of two between -® and 
0 , and two between 0 and +, there are two positive 
and two negative real roots. Actually, this equation 
was arrived at by multiplying out the expression: 
(8+ 1)(S- 2) (8+ 3)(8- 4) (832+ 8+ 1) ; it may be seen 
that this has exactly the distribution of roots predicted 
by the Sturm function process. 


Once the total number of real roots, and their approxi- 
mate locations are known, any of the standard methods 
may be applied to obtain better approximations to the 
roots. When these have been carried out to whatever 
accuracy is desired, the degree of the equation may 
then be successively decreased by one by dividing out 
each of these roots. 


The process of synthetic division is particularly recom- 
mended in this determination of the real roots; if r isa 
root of the equation, synthetic division by it leaves the 
remainder zero, and the partial quotients are the 
coefficients of the equation of next lower degree. If 
r is not an exact root (to that order of approximation 
desired) the last figure resulting from the division is 
the remainder, and may be used as a measure of how 
far away from the true root is the approximation which 
has just been tried. A closer approximation can then 
be obtained by any of the standard methods, and the 
division repeated with the new trial divisor. 


When all the real roots have been removed, not all the 
factors of the original equation may be accounted for. 
It is then necessary to have a process which will extract 
complex roots. Several methods for this purpose are 
in more or less frequent use; of these, the most common 
and best seem to be Graeffe's root squaring method, 
and Lin's method. 


Graeffe's method suffers from certain defects not 
found in some of the others. In the first place, the 
numerical work involved is not of an iterative nature, 
so that an error in computation makes all the rest of 
the application of the process worthless. It is thus 
essential to check all roots obtained by substitution 
into the original equation. Also, the roots are not 
obtained initially as their correct values, but as the 
second, fourth, or some higher even power of the 
roots of the original equation. This means that it 
is necessary o extract the square, fourth, ..., 
(2°)th root of the complex number which the Graeffe 
method gives. This gives rise to additional possibilities 
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